2023-07-23 15:06:42,258 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-23 15:06:42,515 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6 2023-07-23 15:06:42,516 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestSecureExportSnapshot timeout: 13 mins 2023-07-23 15:06:42,557 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-23 15:06:42,811 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-23 15:06:42,811 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/cluster_1af599d2-744d-4b83-6c9a-48c564e4b3e8, deleteOnExit=true 2023-07-23 15:06:42,811 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-23 15:06:42,812 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/test.cache.data in system properties and HBase conf 2023-07-23 15:06:42,813 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/hadoop.tmp.dir in system properties and HBase conf 2023-07-23 15:06:42,813 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/hadoop.log.dir in system properties and HBase conf 2023-07-23 15:06:42,814 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-23 15:06:42,814 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-23 15:06:42,814 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-23 15:06:43,126 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-23 15:06:43,132 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-23 15:06:43,132 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-23 15:06:43,133 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-23 15:06:43,133 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-23 15:06:43,134 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-23 15:06:43,134 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-23 15:06:43,135 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-23 15:06:43,135 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-23 15:06:43,135 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-23 15:06:43,136 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/nfs.dump.dir in system properties and HBase conf 2023-07-23 15:06:43,136 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/java.io.tmpdir in system properties and HBase conf 2023-07-23 15:06:43,137 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-23 15:06:43,137 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-23 15:06:43,137 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-23 15:06:43,732 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-23 15:06:43,737 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-23 15:06:44,008 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-23 15:06:44,196 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-23 15:06:44,208 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-23 15:06:44,242 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-23 15:06:44,274 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/java.io.tmpdir/Jetty_localhost_33005_hdfs____.mm8wap/webapp 2023-07-23 15:06:44,413 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33005 2023-07-23 15:06:44,456 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-23 15:06:44,457 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-23 15:06:44,944 WARN [Listener at localhost/45535] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-23 15:06:45,034 WARN [Listener at localhost/45535] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-23 15:06:45,061 WARN [Listener at localhost/45535] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-23 15:06:45,068 INFO [Listener at localhost/45535] log.Slf4jLog(67): jetty-6.1.26 2023-07-23 15:06:45,075 INFO [Listener at localhost/45535] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/java.io.tmpdir/Jetty_localhost_43677_datanode____.q4dwbm/webapp 2023-07-23 15:06:45,204 INFO [Listener at localhost/45535] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43677 2023-07-23 15:06:45,774 WARN [Listener at localhost/37205] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-23 15:06:45,855 WARN [Listener at localhost/37205] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-23 15:06:45,861 WARN [Listener at localhost/37205] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-23 15:06:45,864 INFO [Listener at localhost/37205] log.Slf4jLog(67): jetty-6.1.26 2023-07-23 15:06:45,873 INFO [Listener at localhost/37205] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/java.io.tmpdir/Jetty_localhost_42063_datanode____2k6s5y/webapp 2023-07-23 15:06:46,037 INFO [Listener at localhost/37205] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42063 2023-07-23 15:06:46,057 WARN [Listener at localhost/36493] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-23 15:06:46,141 WARN [Listener at localhost/36493] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-23 15:06:46,146 WARN [Listener at localhost/36493] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-23 15:06:46,157 INFO [Listener at localhost/36493] log.Slf4jLog(67): jetty-6.1.26 2023-07-23 15:06:46,170 INFO [Listener at localhost/36493] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/java.io.tmpdir/Jetty_localhost_34349_datanode____pp3pem/webapp 2023-07-23 15:06:46,347 INFO [Listener at localhost/36493] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34349 2023-07-23 15:06:46,398 WARN [Listener at localhost/36099] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-23 15:06:46,644 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x19ba7ddfae5eb98e: Processing first storage report for DS-99495c4c-cece-4766-bd40-dee655ab8e7e from datanode 75df1146-43fe-4fbb-b2d1-cef7e0742ddf 2023-07-23 15:06:46,647 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x19ba7ddfae5eb98e: from storage DS-99495c4c-cece-4766-bd40-dee655ab8e7e node DatanodeRegistration(127.0.0.1:35053, datanodeUuid=75df1146-43fe-4fbb-b2d1-cef7e0742ddf, infoPort=34357, infoSecurePort=0, ipcPort=37205, storageInfo=lv=-57;cid=testClusterID;nsid=993144499;c=1690124803804), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-23 15:06:46,647 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x41359fd77272af4f: Processing first storage report for DS-bc86a2ee-c419-4e5c-aff1-16bee4bd845b from datanode 2cb3246c-5bcf-49cb-8949-09f6a494735a 2023-07-23 15:06:46,647 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x41359fd77272af4f: from storage DS-bc86a2ee-c419-4e5c-aff1-16bee4bd845b node DatanodeRegistration(127.0.0.1:41261, datanodeUuid=2cb3246c-5bcf-49cb-8949-09f6a494735a, infoPort=42053, infoSecurePort=0, ipcPort=36493, storageInfo=lv=-57;cid=testClusterID;nsid=993144499;c=1690124803804), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-23 15:06:46,647 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x19ba7ddfae5eb98e: Processing first storage report for DS-07b58a09-76fb-41b6-bc07-544721fe4d2c from datanode 75df1146-43fe-4fbb-b2d1-cef7e0742ddf 2023-07-23 15:06:46,648 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x19ba7ddfae5eb98e: from storage DS-07b58a09-76fb-41b6-bc07-544721fe4d2c node DatanodeRegistration(127.0.0.1:35053, datanodeUuid=75df1146-43fe-4fbb-b2d1-cef7e0742ddf, infoPort=34357, infoSecurePort=0, ipcPort=37205, storageInfo=lv=-57;cid=testClusterID;nsid=993144499;c=1690124803804), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-23 15:06:46,648 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x41359fd77272af4f: Processing first storage report for DS-90675d76-4548-40ba-98ce-8936233c5234 from datanode 2cb3246c-5bcf-49cb-8949-09f6a494735a 2023-07-23 15:06:46,648 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x41359fd77272af4f: from storage DS-90675d76-4548-40ba-98ce-8936233c5234 node DatanodeRegistration(127.0.0.1:41261, datanodeUuid=2cb3246c-5bcf-49cb-8949-09f6a494735a, infoPort=42053, infoSecurePort=0, ipcPort=36493, storageInfo=lv=-57;cid=testClusterID;nsid=993144499;c=1690124803804), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-23 15:06:46,748 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xdd238d8d98e8d36f: Processing first storage report for DS-70414d91-22bc-4c37-9f69-1066c869fc70 from datanode 4f6bb693-a32e-4ced-9bf1-f2622ba7195f 2023-07-23 15:06:46,748 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xdd238d8d98e8d36f: from storage DS-70414d91-22bc-4c37-9f69-1066c869fc70 node DatanodeRegistration(127.0.0.1:39285, datanodeUuid=4f6bb693-a32e-4ced-9bf1-f2622ba7195f, infoPort=36389, infoSecurePort=0, ipcPort=36099, storageInfo=lv=-57;cid=testClusterID;nsid=993144499;c=1690124803804), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-23 15:06:46,748 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xdd238d8d98e8d36f: Processing first storage report for DS-344b1319-48b8-482f-9017-391c2dbb657d from datanode 4f6bb693-a32e-4ced-9bf1-f2622ba7195f 2023-07-23 15:06:46,748 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xdd238d8d98e8d36f: from storage DS-344b1319-48b8-482f-9017-391c2dbb657d node DatanodeRegistration(127.0.0.1:39285, datanodeUuid=4f6bb693-a32e-4ced-9bf1-f2622ba7195f, infoPort=36389, infoSecurePort=0, ipcPort=36099, storageInfo=lv=-57;cid=testClusterID;nsid=993144499;c=1690124803804), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-23 15:06:46,984 DEBUG [Listener at localhost/36099] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6 2023-07-23 15:06:47,061 INFO [Listener at localhost/36099] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/cluster_1af599d2-744d-4b83-6c9a-48c564e4b3e8/zookeeper_0, clientPort=51019, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/cluster_1af599d2-744d-4b83-6c9a-48c564e4b3e8/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/cluster_1af599d2-744d-4b83-6c9a-48c564e4b3e8/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-23 15:06:47,078 INFO [Listener at localhost/36099] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=51019 2023-07-23 15:06:47,090 INFO [Listener at localhost/36099] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 15:06:47,092 INFO [Listener at localhost/36099] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 15:06:47,803 INFO [Listener at localhost/36099] util.FSUtils(471): Created version file at hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40 with version=8 2023-07-23 15:06:47,803 INFO [Listener at localhost/36099] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/hbase-staging 2023-07-23 15:06:48,170 INFO [Listener at localhost/36099] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-23 15:06:48,811 INFO [Listener at localhost/36099] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-23 15:06:48,848 INFO [Listener at localhost/36099] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-23 15:06:48,848 INFO [Listener at localhost/36099] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-23 15:06:48,849 INFO [Listener at localhost/36099] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-23 15:06:48,849 INFO [Listener at localhost/36099] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-23 15:06:48,849 INFO [Listener at localhost/36099] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-23 15:06:49,034 INFO [Listener at localhost/36099] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-23 15:06:49,110 DEBUG [Listener at localhost/36099] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-23 15:06:49,221 INFO [Listener at localhost/36099] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38379 2023-07-23 15:06:49,240 INFO [Listener at localhost/36099] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 15:06:49,241 INFO [Listener at localhost/36099] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 15:06:49,267 INFO [Listener at localhost/36099] zookeeper.RecoverableZooKeeper(93): Process identifier=master:38379 connecting to ZooKeeper ensemble=127.0.0.1:51019 2023-07-23 15:06:49,328 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:383790x0, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-23 15:06:49,336 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:38379-0x10192b86e830000 connected 2023-07-23 15:06:49,377 DEBUG [Listener at localhost/36099] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-23 15:06:49,378 DEBUG [Listener at localhost/36099] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-23 15:06:49,393 DEBUG [Listener at localhost/36099] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-23 15:06:49,402 DEBUG [Listener at localhost/36099] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38379 2023-07-23 15:06:49,403 DEBUG [Listener at localhost/36099] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38379 2023-07-23 15:06:49,406 DEBUG [Listener at localhost/36099] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38379 2023-07-23 15:06:49,408 DEBUG [Listener at localhost/36099] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38379 2023-07-23 15:06:49,409 DEBUG [Listener at localhost/36099] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38379 2023-07-23 15:06:49,417 INFO [Listener at localhost/36099] master.HMaster(444): hbase.rootdir=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40, hbase.cluster.distributed=false 2023-07-23 15:06:49,506 INFO [Listener at localhost/36099] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-23 15:06:49,506 INFO [Listener at localhost/36099] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-23 15:06:49,507 INFO [Listener at localhost/36099] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-23 15:06:49,507 INFO [Listener at localhost/36099] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-23 15:06:49,507 INFO [Listener at localhost/36099] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-23 15:06:49,507 INFO [Listener at localhost/36099] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-23 15:06:49,512 INFO [Listener at localhost/36099] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-23 15:06:49,520 INFO [Listener at localhost/36099] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34279 2023-07-23 15:06:49,523 INFO [Listener at localhost/36099] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-23 15:06:49,531 DEBUG [Listener at localhost/36099] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-23 15:06:49,533 INFO [Listener at localhost/36099] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 15:06:49,536 INFO [Listener at localhost/36099] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 15:06:49,538 INFO [Listener at localhost/36099] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34279 connecting to ZooKeeper ensemble=127.0.0.1:51019 2023-07-23 15:06:49,554 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:342790x0, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-23 15:06:49,558 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:34279-0x10192b86e830001 connected 2023-07-23 15:06:49,559 DEBUG [Listener at localhost/36099] zookeeper.ZKUtil(164): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-23 15:06:49,561 DEBUG [Listener at localhost/36099] zookeeper.ZKUtil(164): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-23 15:06:49,562 DEBUG [Listener at localhost/36099] zookeeper.ZKUtil(164): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-23 15:06:49,575 DEBUG [Listener at localhost/36099] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34279 2023-07-23 15:06:49,576 DEBUG [Listener at localhost/36099] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34279 2023-07-23 15:06:49,579 DEBUG [Listener at localhost/36099] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34279 2023-07-23 15:06:49,581 DEBUG [Listener at localhost/36099] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34279 2023-07-23 15:06:49,581 DEBUG [Listener at localhost/36099] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34279 2023-07-23 15:06:49,598 INFO [Listener at localhost/36099] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-23 15:06:49,598 INFO [Listener at localhost/36099] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-23 15:06:49,598 INFO [Listener at localhost/36099] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-23 15:06:49,599 INFO [Listener at localhost/36099] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-23 15:06:49,599 INFO [Listener at localhost/36099] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-23 15:06:49,599 INFO [Listener at localhost/36099] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-23 15:06:49,600 INFO [Listener at localhost/36099] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-23 15:06:49,604 INFO [Listener at localhost/36099] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46239 2023-07-23 15:06:49,605 INFO [Listener at localhost/36099] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-23 15:06:49,619 DEBUG [Listener at localhost/36099] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-23 15:06:49,620 INFO [Listener at localhost/36099] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 15:06:49,623 INFO [Listener at localhost/36099] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 15:06:49,626 INFO [Listener at localhost/36099] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46239 connecting to ZooKeeper ensemble=127.0.0.1:51019 2023-07-23 15:06:49,636 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:462390x0, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-23 15:06:49,637 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:46239-0x10192b86e830002 connected 2023-07-23 15:06:49,637 DEBUG [Listener at localhost/36099] zookeeper.ZKUtil(164): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-23 15:06:49,638 DEBUG [Listener at localhost/36099] zookeeper.ZKUtil(164): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-23 15:06:49,639 DEBUG [Listener at localhost/36099] zookeeper.ZKUtil(164): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-23 15:06:49,640 DEBUG [Listener at localhost/36099] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46239 2023-07-23 15:06:49,640 DEBUG [Listener at localhost/36099] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46239 2023-07-23 15:06:49,642 DEBUG [Listener at localhost/36099] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46239 2023-07-23 15:06:49,643 DEBUG [Listener at localhost/36099] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46239 2023-07-23 15:06:49,643 DEBUG [Listener at localhost/36099] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46239 2023-07-23 15:06:49,655 INFO [Listener at localhost/36099] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-23 15:06:49,655 INFO [Listener at localhost/36099] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-23 15:06:49,655 INFO [Listener at localhost/36099] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-23 15:06:49,656 INFO [Listener at localhost/36099] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-23 15:06:49,656 INFO [Listener at localhost/36099] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-23 15:06:49,656 INFO [Listener at localhost/36099] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-23 15:06:49,656 INFO [Listener at localhost/36099] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-23 15:06:49,658 INFO [Listener at localhost/36099] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46191 2023-07-23 15:06:49,659 INFO [Listener at localhost/36099] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-23 15:06:49,663 DEBUG [Listener at localhost/36099] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-23 15:06:49,664 INFO [Listener at localhost/36099] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 15:06:49,665 INFO [Listener at localhost/36099] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 15:06:49,667 INFO [Listener at localhost/36099] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46191 connecting to ZooKeeper ensemble=127.0.0.1:51019 2023-07-23 15:06:49,675 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:461910x0, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-23 15:06:49,676 DEBUG [Listener at localhost/36099] zookeeper.ZKUtil(164): regionserver:461910x0, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-23 15:06:49,677 DEBUG [Listener at localhost/36099] zookeeper.ZKUtil(164): regionserver:461910x0, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-23 15:06:49,677 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:46191-0x10192b86e830003 connected 2023-07-23 15:06:49,678 DEBUG [Listener at localhost/36099] zookeeper.ZKUtil(164): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-23 15:06:49,679 DEBUG [Listener at localhost/36099] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46191 2023-07-23 15:06:49,680 DEBUG [Listener at localhost/36099] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46191 2023-07-23 15:06:49,680 DEBUG [Listener at localhost/36099] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46191 2023-07-23 15:06:49,680 DEBUG [Listener at localhost/36099] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46191 2023-07-23 15:06:49,681 DEBUG [Listener at localhost/36099] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46191 2023-07-23 15:06:49,685 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,38379,1690124807983 2023-07-23 15:06:49,695 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-23 15:06:49,698 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,38379,1690124807983 2023-07-23 15:06:49,721 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-23 15:06:49,721 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 15:06:49,722 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-23 15:06:49,721 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-23 15:06:49,721 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-23 15:06:49,724 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-23 15:06:49,725 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-23 15:06:49,727 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,38379,1690124807983 from backup master directory 2023-07-23 15:06:49,731 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,38379,1690124807983 2023-07-23 15:06:49,731 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-23 15:06:49,731 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-23 15:06:49,732 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,38379,1690124807983 2023-07-23 15:06:49,735 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-23 15:06:49,736 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-23 15:06:49,857 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/hbase.id with ID: 443b082e-459c-4c3e-bcf7-15c026df27d9 2023-07-23 15:06:49,899 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 15:06:49,916 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 15:06:49,971 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x11e331ef to 127.0.0.1:51019 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 15:06:50,013 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2a7f51f4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 15:06:50,048 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-23 15:06:50,051 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-23 15:06:50,076 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-23 15:06:50,077 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-23 15:06:50,079 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-23 15:06:50,085 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-23 15:06:50,087 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-23 15:06:50,138 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/MasterData/data/master/store-tmp 2023-07-23 15:06:50,196 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:06:50,197 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-23 15:06:50,197 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-23 15:06:50,197 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-23 15:06:50,197 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-23 15:06:50,197 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-23 15:06:50,197 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-23 15:06:50,198 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-23 15:06:50,200 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/MasterData/WALs/jenkins-hbase4.apache.org,38379,1690124807983 2023-07-23 15:06:50,227 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38379%2C1690124807983, suffix=, logDir=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/MasterData/WALs/jenkins-hbase4.apache.org,38379,1690124807983, archiveDir=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/MasterData/oldWALs, maxLogs=10 2023-07-23 15:06:50,307 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35053,DS-99495c4c-cece-4766-bd40-dee655ab8e7e,DISK] 2023-07-23 15:06:50,307 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41261,DS-bc86a2ee-c419-4e5c-aff1-16bee4bd845b,DISK] 2023-07-23 15:06:50,307 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39285,DS-70414d91-22bc-4c37-9f69-1066c869fc70,DISK] 2023-07-23 15:06:50,316 DEBUG [RS-EventLoopGroup-5-1] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-23 15:06:50,409 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/MasterData/WALs/jenkins-hbase4.apache.org,38379,1690124807983/jenkins-hbase4.apache.org%2C38379%2C1690124807983.1690124810238 2023-07-23 15:06:50,410 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39285,DS-70414d91-22bc-4c37-9f69-1066c869fc70,DISK], DatanodeInfoWithStorage[127.0.0.1:41261,DS-bc86a2ee-c419-4e5c-aff1-16bee4bd845b,DISK], DatanodeInfoWithStorage[127.0.0.1:35053,DS-99495c4c-cece-4766-bd40-dee655ab8e7e,DISK]] 2023-07-23 15:06:50,410 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-23 15:06:50,411 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:06:50,414 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-23 15:06:50,415 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-23 15:06:50,495 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-23 15:06:50,503 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-23 15:06:50,536 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-23 15:06:50,575 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 15:06:50,582 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-23 15:06:50,586 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-23 15:06:50,604 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-23 15:06:50,611 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 15:06:50,612 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59124184, jitterRate=-0.1189810037612915}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 15:06:50,613 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-23 15:06:50,615 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-23 15:06:50,639 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-23 15:06:50,639 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-23 15:06:50,642 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-23 15:06:50,644 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-23 15:06:50,689 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 45 msec 2023-07-23 15:06:50,689 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-23 15:06:50,727 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-23 15:06:50,734 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-23 15:06:50,769 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-23 15:06:50,777 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-23 15:06:50,778 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-23 15:06:50,787 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-23 15:06:50,793 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-23 15:06:50,799 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 15:06:50,802 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-23 15:06:50,803 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-23 15:06:50,817 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-23 15:06:50,823 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-23 15:06:50,823 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-23 15:06:50,823 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-23 15:06:50,823 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-23 15:06:50,823 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 15:06:50,824 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,38379,1690124807983, sessionid=0x10192b86e830000, setting cluster-up flag (Was=false) 2023-07-23 15:06:50,846 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 15:06:50,852 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-23 15:06:50,854 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,38379,1690124807983 2023-07-23 15:06:50,860 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 15:06:50,866 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-23 15:06:50,868 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,38379,1690124807983 2023-07-23 15:06:50,871 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/.tmp 2023-07-23 15:06:50,891 INFO [RS:0;jenkins-hbase4:34279] regionserver.HRegionServer(951): ClusterId : 443b082e-459c-4c3e-bcf7-15c026df27d9 2023-07-23 15:06:50,891 INFO [RS:2;jenkins-hbase4:46191] regionserver.HRegionServer(951): ClusterId : 443b082e-459c-4c3e-bcf7-15c026df27d9 2023-07-23 15:06:50,891 INFO [RS:1;jenkins-hbase4:46239] regionserver.HRegionServer(951): ClusterId : 443b082e-459c-4c3e-bcf7-15c026df27d9 2023-07-23 15:06:50,899 DEBUG [RS:0;jenkins-hbase4:34279] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-23 15:06:50,902 DEBUG [RS:2;jenkins-hbase4:46191] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-23 15:06:50,902 DEBUG [RS:1;jenkins-hbase4:46239] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-23 15:06:50,916 DEBUG [RS:2;jenkins-hbase4:46191] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-23 15:06:50,916 DEBUG [RS:0;jenkins-hbase4:34279] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-23 15:06:50,916 DEBUG [RS:1;jenkins-hbase4:46239] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-23 15:06:50,916 DEBUG [RS:1;jenkins-hbase4:46239] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-23 15:06:50,916 DEBUG [RS:0;jenkins-hbase4:34279] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-23 15:06:50,916 DEBUG [RS:2;jenkins-hbase4:46191] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-23 15:06:50,922 DEBUG [RS:2;jenkins-hbase4:46191] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-23 15:06:50,922 DEBUG [RS:1;jenkins-hbase4:46239] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-23 15:06:50,924 DEBUG [RS:0;jenkins-hbase4:34279] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-23 15:06:50,929 DEBUG [RS:2;jenkins-hbase4:46191] zookeeper.ReadOnlyZKClient(139): Connect 0x3a44caff to 127.0.0.1:51019 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 15:06:50,929 DEBUG [RS:1;jenkins-hbase4:46239] zookeeper.ReadOnlyZKClient(139): Connect 0x6d79c67c to 127.0.0.1:51019 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 15:06:50,930 DEBUG [RS:0;jenkins-hbase4:34279] zookeeper.ReadOnlyZKClient(139): Connect 0x41a323be to 127.0.0.1:51019 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 15:06:50,956 DEBUG [RS:2;jenkins-hbase4:46191] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6cf38307, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 15:06:50,957 DEBUG [RS:2;jenkins-hbase4:46191] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@42394a75, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-23 15:06:50,987 DEBUG [RS:0;jenkins-hbase4:34279] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@67d3813e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 15:06:50,988 DEBUG [RS:0;jenkins-hbase4:34279] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@33c3f8ae, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-23 15:06:50,989 DEBUG [RS:1;jenkins-hbase4:46239] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@63be25a3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 15:06:50,989 DEBUG [RS:1;jenkins-hbase4:46239] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6781ad0c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-23 15:06:50,996 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-23 15:06:51,001 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 15:06:51,002 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-23 15:06:51,002 DEBUG [RS:0;jenkins-hbase4:34279] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:34279 2023-07-23 15:06:51,003 DEBUG [RS:1;jenkins-hbase4:46239] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:46239 2023-07-23 15:06:51,009 INFO [RS:0;jenkins-hbase4:34279] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-23 15:06:51,009 INFO [RS:0;jenkins-hbase4:34279] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-23 15:06:51,009 DEBUG [RS:0;jenkins-hbase4:34279] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-23 15:06:51,010 INFO [RS:1;jenkins-hbase4:46239] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-23 15:06:51,010 INFO [RS:0;jenkins-hbase4:34279] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 15:06:51,011 INFO [RS:1;jenkins-hbase4:46239] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-23 15:06:51,011 DEBUG [RS:0;jenkins-hbase4:34279] regionserver.HRegionServer(1022): About to register with Master. 2023-07-23 15:06:51,011 DEBUG [RS:1;jenkins-hbase4:46239] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-23 15:06:51,011 INFO [RS:1;jenkins-hbase4:46239] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 15:06:51,011 DEBUG [RS:1;jenkins-hbase4:46239] regionserver.HRegionServer(1022): About to register with Master. 2023-07-23 15:06:51,014 INFO [RS:0;jenkins-hbase4:34279] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,38379,1690124807983 with isa=jenkins-hbase4.apache.org/172.31.14.131:34279, startcode=1690124809505 2023-07-23 15:06:51,015 INFO [RS:1;jenkins-hbase4:46239] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,38379,1690124807983 with isa=jenkins-hbase4.apache.org/172.31.14.131:46239, startcode=1690124809597 2023-07-23 15:06:51,017 DEBUG [RS:2;jenkins-hbase4:46191] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:46191 2023-07-23 15:06:51,017 INFO [RS:2;jenkins-hbase4:46191] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-23 15:06:51,017 INFO [RS:2;jenkins-hbase4:46191] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-23 15:06:51,017 DEBUG [RS:2;jenkins-hbase4:46191] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-23 15:06:51,017 INFO [RS:2;jenkins-hbase4:46191] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 15:06:51,017 DEBUG [RS:2;jenkins-hbase4:46191] regionserver.HRegionServer(1022): About to register with Master. 2023-07-23 15:06:51,018 INFO [RS:2;jenkins-hbase4:46191] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,38379,1690124807983 with isa=jenkins-hbase4.apache.org/172.31.14.131:46191, startcode=1690124809654 2023-07-23 15:06:51,039 DEBUG [RS:0;jenkins-hbase4:34279] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-23 15:06:51,039 DEBUG [RS:2;jenkins-hbase4:46191] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-23 15:06:51,039 DEBUG [RS:1;jenkins-hbase4:46239] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-23 15:06:51,117 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54389, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-23 15:06:51,119 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49221, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-23 15:06:51,118 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54015, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-23 15:06:51,129 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38379] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-23 15:06:51,133 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-23 15:06:51,141 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38379] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-23 15:06:51,147 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38379] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-23 15:06:51,178 DEBUG [RS:2;jenkins-hbase4:46191] regionserver.HRegionServer(2830): Master is not running yet 2023-07-23 15:06:51,178 WARN [RS:2;jenkins-hbase4:46191] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-23 15:06:51,178 DEBUG [RS:1;jenkins-hbase4:46239] regionserver.HRegionServer(2830): Master is not running yet 2023-07-23 15:06:51,178 WARN [RS:1;jenkins-hbase4:46239] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-23 15:06:51,178 DEBUG [RS:0;jenkins-hbase4:34279] regionserver.HRegionServer(2830): Master is not running yet 2023-07-23 15:06:51,179 WARN [RS:0;jenkins-hbase4:34279] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-23 15:06:51,181 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-23 15:06:51,182 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-23 15:06:51,182 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-23 15:06:51,182 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-23 15:06:51,182 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-23 15:06:51,182 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 15:06:51,182 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-23 15:06:51,182 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 15:06:51,208 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1690124841208 2023-07-23 15:06:51,211 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-23 15:06:51,229 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-23 15:06:51,230 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-23 15:06:51,232 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-23 15:06:51,236 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-23 15:06:51,250 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-23 15:06:51,250 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-23 15:06:51,251 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-23 15:06:51,251 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-23 15:06:51,255 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-23 15:06:51,261 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-23 15:06:51,263 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-23 15:06:51,264 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-23 15:06:51,271 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-23 15:06:51,272 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-23 15:06:51,280 INFO [RS:2;jenkins-hbase4:46191] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,38379,1690124807983 with isa=jenkins-hbase4.apache.org/172.31.14.131:46191, startcode=1690124809654 2023-07-23 15:06:51,280 INFO [RS:0;jenkins-hbase4:34279] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,38379,1690124807983 with isa=jenkins-hbase4.apache.org/172.31.14.131:34279, startcode=1690124809505 2023-07-23 15:06:51,283 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38379] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-23 15:06:51,283 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38379] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-23 15:06:51,287 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1690124811282,5,FailOnTimeoutGroup] 2023-07-23 15:06:51,287 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1690124811287,5,FailOnTimeoutGroup] 2023-07-23 15:06:51,299 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-23 15:06:51,299 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-23 15:06:51,301 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-23 15:06:51,302 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-23 15:06:51,304 DEBUG [RS:0;jenkins-hbase4:34279] regionserver.HRegionServer(2830): Master is not running yet 2023-07-23 15:06:51,304 WARN [RS:0;jenkins-hbase4:34279] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 200 ms and then retrying. 2023-07-23 15:06:51,304 DEBUG [RS:2;jenkins-hbase4:46191] regionserver.HRegionServer(2830): Master is not running yet 2023-07-23 15:06:51,304 WARN [RS:2;jenkins-hbase4:46191] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 200 ms and then retrying. 2023-07-23 15:06:51,305 INFO [RS:1;jenkins-hbase4:46239] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,38379,1690124807983 with isa=jenkins-hbase4.apache.org/172.31.14.131:46239, startcode=1690124809597 2023-07-23 15:06:51,314 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38379] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:06:51,322 DEBUG [RS:1;jenkins-hbase4:46239] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40 2023-07-23 15:06:51,322 DEBUG [RS:1;jenkins-hbase4:46239] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:45535 2023-07-23 15:06:51,322 DEBUG [RS:1;jenkins-hbase4:46239] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-23 15:06:51,338 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-23 15:06:51,339 DEBUG [RS:1;jenkins-hbase4:46239] zookeeper.ZKUtil(162): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:06:51,339 WARN [RS:1;jenkins-hbase4:46239] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-23 15:06:51,349 INFO [RS:1;jenkins-hbase4:46239] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-23 15:06:51,351 DEBUG [RS:1;jenkins-hbase4:46239] regionserver.HRegionServer(1948): logDir=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/WALs/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:06:51,354 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,46239,1690124809597] 2023-07-23 15:06:51,381 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-23 15:06:51,382 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-23 15:06:51,383 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40 2023-07-23 15:06:51,386 DEBUG [RS:1;jenkins-hbase4:46239] zookeeper.ZKUtil(162): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:06:51,406 DEBUG [RS:1;jenkins-hbase4:46239] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-23 15:06:51,417 INFO [RS:1;jenkins-hbase4:46239] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-23 15:06:51,447 INFO [RS:1;jenkins-hbase4:46239] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-23 15:06:51,458 INFO [RS:1;jenkins-hbase4:46239] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-23 15:06:51,459 INFO [RS:1;jenkins-hbase4:46239] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-23 15:06:51,463 INFO [RS:1;jenkins-hbase4:46239] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-23 15:06:51,464 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:06:51,468 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-23 15:06:51,472 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/hbase/meta/1588230740/info 2023-07-23 15:06:51,473 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-23 15:06:51,474 INFO [RS:1;jenkins-hbase4:46239] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-23 15:06:51,474 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 15:06:51,474 DEBUG [RS:1;jenkins-hbase4:46239] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 15:06:51,474 DEBUG [RS:1;jenkins-hbase4:46239] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 15:06:51,474 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-23 15:06:51,475 DEBUG [RS:1;jenkins-hbase4:46239] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 15:06:51,475 DEBUG [RS:1;jenkins-hbase4:46239] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 15:06:51,475 DEBUG [RS:1;jenkins-hbase4:46239] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 15:06:51,475 DEBUG [RS:1;jenkins-hbase4:46239] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-23 15:06:51,475 DEBUG [RS:1;jenkins-hbase4:46239] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 15:06:51,475 DEBUG [RS:1;jenkins-hbase4:46239] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 15:06:51,475 DEBUG [RS:1;jenkins-hbase4:46239] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 15:06:51,476 DEBUG [RS:1;jenkins-hbase4:46239] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 15:06:51,484 INFO [RS:1;jenkins-hbase4:46239] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-23 15:06:51,484 INFO [RS:1;jenkins-hbase4:46239] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-23 15:06:51,484 INFO [RS:1;jenkins-hbase4:46239] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-23 15:06:51,486 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/hbase/meta/1588230740/rep_barrier 2023-07-23 15:06:51,486 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-23 15:06:51,487 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 15:06:51,488 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-23 15:06:51,496 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/hbase/meta/1588230740/table 2023-07-23 15:06:51,497 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-23 15:06:51,497 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 15:06:51,500 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/hbase/meta/1588230740 2023-07-23 15:06:51,501 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/hbase/meta/1588230740 2023-07-23 15:06:51,506 INFO [RS:0;jenkins-hbase4:34279] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,38379,1690124807983 with isa=jenkins-hbase4.apache.org/172.31.14.131:34279, startcode=1690124809505 2023-07-23 15:06:51,507 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38379] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:06:51,508 INFO [RS:2;jenkins-hbase4:46191] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,38379,1690124807983 with isa=jenkins-hbase4.apache.org/172.31.14.131:46191, startcode=1690124809654 2023-07-23 15:06:51,509 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38379] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:06:51,510 DEBUG [RS:0;jenkins-hbase4:34279] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40 2023-07-23 15:06:51,510 DEBUG [RS:0;jenkins-hbase4:34279] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:45535 2023-07-23 15:06:51,510 DEBUG [RS:0;jenkins-hbase4:34279] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-23 15:06:51,512 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-23 15:06:51,512 DEBUG [RS:2;jenkins-hbase4:46191] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40 2023-07-23 15:06:51,512 DEBUG [RS:2;jenkins-hbase4:46191] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:45535 2023-07-23 15:06:51,512 DEBUG [RS:2;jenkins-hbase4:46191] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-23 15:06:51,515 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-23 15:06:51,522 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-23 15:06:51,522 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-23 15:06:51,528 DEBUG [RS:0;jenkins-hbase4:34279] zookeeper.ZKUtil(162): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:06:51,528 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34279,1690124809505] 2023-07-23 15:06:51,529 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,46191,1690124809654] 2023-07-23 15:06:51,530 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:06:51,530 DEBUG [RS:2;jenkins-hbase4:46191] zookeeper.ZKUtil(162): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:06:51,530 WARN [RS:2;jenkins-hbase4:46191] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-23 15:06:51,528 WARN [RS:0;jenkins-hbase4:34279] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-23 15:06:51,530 INFO [RS:1;jenkins-hbase4:46239] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-23 15:06:51,531 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:06:51,534 INFO [RS:1;jenkins-hbase4:46239] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46239,1690124809597-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-23 15:06:51,536 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:06:51,530 INFO [RS:2;jenkins-hbase4:46191] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-23 15:06:51,530 INFO [RS:0;jenkins-hbase4:34279] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-23 15:06:51,545 DEBUG [RS:2;jenkins-hbase4:46191] regionserver.HRegionServer(1948): logDir=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/WALs/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:06:51,546 DEBUG [RS:0;jenkins-hbase4:34279] regionserver.HRegionServer(1948): logDir=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/WALs/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:06:51,554 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 15:06:51,565 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75391647, jitterRate=0.12342308461666107}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-23 15:06:51,565 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-23 15:06:51,566 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-23 15:06:51,566 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-23 15:06:51,566 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-23 15:06:51,566 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-23 15:06:51,566 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-23 15:06:51,567 DEBUG [RS:2;jenkins-hbase4:46191] zookeeper.ZKUtil(162): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:06:51,568 DEBUG [RS:2;jenkins-hbase4:46191] zookeeper.ZKUtil(162): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:06:51,569 DEBUG [RS:2;jenkins-hbase4:46191] zookeeper.ZKUtil(162): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:06:51,570 DEBUG [RS:2;jenkins-hbase4:46191] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-23 15:06:51,579 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-23 15:06:51,579 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-23 15:06:51,582 INFO [RS:2;jenkins-hbase4:46191] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-23 15:06:51,602 INFO [RS:1;jenkins-hbase4:46239] regionserver.Replication(203): jenkins-hbase4.apache.org,46239,1690124809597 started 2023-07-23 15:06:51,603 INFO [RS:1;jenkins-hbase4:46239] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,46239,1690124809597, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:46239, sessionid=0x10192b86e830002 2023-07-23 15:06:51,603 DEBUG [RS:1;jenkins-hbase4:46239] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-23 15:06:51,603 DEBUG [RS:1;jenkins-hbase4:46239] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:06:51,603 DEBUG [RS:1;jenkins-hbase4:46239] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46239,1690124809597' 2023-07-23 15:06:51,603 DEBUG [RS:1;jenkins-hbase4:46239] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-23 15:06:51,604 DEBUG [RS:1;jenkins-hbase4:46239] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-23 15:06:51,606 DEBUG [RS:1;jenkins-hbase4:46239] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-23 15:06:51,606 DEBUG [RS:1;jenkins-hbase4:46239] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-23 15:06:51,606 DEBUG [RS:1;jenkins-hbase4:46239] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:06:51,606 DEBUG [RS:1;jenkins-hbase4:46239] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46239,1690124809597' 2023-07-23 15:06:51,606 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-23 15:06:51,606 DEBUG [RS:1;jenkins-hbase4:46239] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:06:51,606 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-23 15:06:51,605 INFO [RS:2;jenkins-hbase4:46191] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-23 15:06:51,608 DEBUG [RS:1;jenkins-hbase4:46239] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:06:51,608 DEBUG [RS:1;jenkins-hbase4:46239] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-23 15:06:51,608 INFO [RS:1;jenkins-hbase4:46239] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-23 15:06:51,608 INFO [RS:1;jenkins-hbase4:46239] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-23 15:06:51,608 INFO [RS:2;jenkins-hbase4:46191] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-23 15:06:51,610 INFO [RS:2;jenkins-hbase4:46191] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-23 15:06:51,611 DEBUG [RS:0;jenkins-hbase4:34279] zookeeper.ZKUtil(162): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:06:51,611 INFO [RS:2;jenkins-hbase4:46191] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-23 15:06:51,612 DEBUG [RS:0;jenkins-hbase4:34279] zookeeper.ZKUtil(162): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:06:51,613 DEBUG [RS:0;jenkins-hbase4:34279] zookeeper.ZKUtil(162): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:06:51,614 INFO [RS:2;jenkins-hbase4:46191] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-23 15:06:51,614 DEBUG [RS:2;jenkins-hbase4:46191] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 15:06:51,615 DEBUG [RS:2;jenkins-hbase4:46191] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 15:06:51,615 DEBUG [RS:2;jenkins-hbase4:46191] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 15:06:51,615 DEBUG [RS:2;jenkins-hbase4:46191] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 15:06:51,615 DEBUG [RS:2;jenkins-hbase4:46191] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 15:06:51,616 DEBUG [RS:2;jenkins-hbase4:46191] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-23 15:06:51,616 DEBUG [RS:2;jenkins-hbase4:46191] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 15:06:51,616 DEBUG [RS:2;jenkins-hbase4:46191] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 15:06:51,616 DEBUG [RS:2;jenkins-hbase4:46191] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 15:06:51,616 DEBUG [RS:0;jenkins-hbase4:34279] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-23 15:06:51,616 DEBUG [RS:2;jenkins-hbase4:46191] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 15:06:51,616 INFO [RS:0;jenkins-hbase4:34279] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-23 15:06:51,621 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-23 15:06:51,627 INFO [RS:0;jenkins-hbase4:34279] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-23 15:06:51,633 INFO [RS:2;jenkins-hbase4:46191] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-23 15:06:51,634 INFO [RS:2;jenkins-hbase4:46191] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-23 15:06:51,634 INFO [RS:2;jenkins-hbase4:46191] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-23 15:06:51,637 INFO [RS:0;jenkins-hbase4:34279] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-23 15:06:51,637 INFO [RS:0;jenkins-hbase4:34279] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-23 15:06:51,638 INFO [RS:0;jenkins-hbase4:34279] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-23 15:06:51,645 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-23 15:06:51,645 INFO [RS:0;jenkins-hbase4:34279] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-23 15:06:51,645 DEBUG [RS:0;jenkins-hbase4:34279] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 15:06:51,647 DEBUG [RS:0;jenkins-hbase4:34279] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 15:06:51,647 DEBUG [RS:0;jenkins-hbase4:34279] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 15:06:51,647 DEBUG [RS:0;jenkins-hbase4:34279] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 15:06:51,647 DEBUG [RS:0;jenkins-hbase4:34279] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 15:06:51,648 DEBUG [RS:0;jenkins-hbase4:34279] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-23 15:06:51,648 DEBUG [RS:0;jenkins-hbase4:34279] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 15:06:51,648 DEBUG [RS:0;jenkins-hbase4:34279] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 15:06:51,648 DEBUG [RS:0;jenkins-hbase4:34279] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 15:06:51,648 DEBUG [RS:0;jenkins-hbase4:34279] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 15:06:51,652 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-23 15:06:51,658 INFO [RS:0;jenkins-hbase4:34279] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-23 15:06:51,659 INFO [RS:0;jenkins-hbase4:34279] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-23 15:06:51,659 INFO [RS:0;jenkins-hbase4:34279] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-23 15:06:51,661 INFO [RS:2;jenkins-hbase4:46191] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-23 15:06:51,662 INFO [RS:2;jenkins-hbase4:46191] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46191,1690124809654-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-23 15:06:51,683 INFO [RS:2;jenkins-hbase4:46191] regionserver.Replication(203): jenkins-hbase4.apache.org,46191,1690124809654 started 2023-07-23 15:06:51,683 INFO [RS:2;jenkins-hbase4:46191] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,46191,1690124809654, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:46191, sessionid=0x10192b86e830003 2023-07-23 15:06:51,683 DEBUG [RS:2;jenkins-hbase4:46191] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-23 15:06:51,683 DEBUG [RS:2;jenkins-hbase4:46191] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:06:51,684 DEBUG [RS:2;jenkins-hbase4:46191] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46191,1690124809654' 2023-07-23 15:06:51,687 DEBUG [RS:2;jenkins-hbase4:46191] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-23 15:06:51,688 DEBUG [RS:2;jenkins-hbase4:46191] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-23 15:06:51,688 DEBUG [RS:2;jenkins-hbase4:46191] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-23 15:06:51,689 DEBUG [RS:2;jenkins-hbase4:46191] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-23 15:06:51,689 DEBUG [RS:2;jenkins-hbase4:46191] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:06:51,689 DEBUG [RS:2;jenkins-hbase4:46191] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46191,1690124809654' 2023-07-23 15:06:51,689 DEBUG [RS:2;jenkins-hbase4:46191] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:06:51,690 DEBUG [RS:2;jenkins-hbase4:46191] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:06:51,690 DEBUG [RS:2;jenkins-hbase4:46191] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-23 15:06:51,690 INFO [RS:2;jenkins-hbase4:46191] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-23 15:06:51,692 INFO [RS:2;jenkins-hbase4:46191] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-23 15:06:51,699 INFO [RS:0;jenkins-hbase4:34279] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-23 15:06:51,699 INFO [RS:0;jenkins-hbase4:34279] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34279,1690124809505-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-23 15:06:51,722 INFO [RS:1;jenkins-hbase4:46239] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46239%2C1690124809597, suffix=, logDir=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/WALs/jenkins-hbase4.apache.org,46239,1690124809597, archiveDir=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/oldWALs, maxLogs=32 2023-07-23 15:06:51,728 INFO [RS:0;jenkins-hbase4:34279] regionserver.Replication(203): jenkins-hbase4.apache.org,34279,1690124809505 started 2023-07-23 15:06:51,729 INFO [RS:0;jenkins-hbase4:34279] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,34279,1690124809505, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34279, sessionid=0x10192b86e830001 2023-07-23 15:06:51,729 DEBUG [RS:0;jenkins-hbase4:34279] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-23 15:06:51,729 DEBUG [RS:0;jenkins-hbase4:34279] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:06:51,729 DEBUG [RS:0;jenkins-hbase4:34279] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34279,1690124809505' 2023-07-23 15:06:51,729 DEBUG [RS:0;jenkins-hbase4:34279] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-23 15:06:51,730 DEBUG [RS:0;jenkins-hbase4:34279] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-23 15:06:51,730 DEBUG [RS:0;jenkins-hbase4:34279] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-23 15:06:51,731 DEBUG [RS:0;jenkins-hbase4:34279] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-23 15:06:51,731 DEBUG [RS:0;jenkins-hbase4:34279] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:06:51,731 DEBUG [RS:0;jenkins-hbase4:34279] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34279,1690124809505' 2023-07-23 15:06:51,731 DEBUG [RS:0;jenkins-hbase4:34279] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:06:51,731 DEBUG [RS:0;jenkins-hbase4:34279] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:06:51,732 DEBUG [RS:0;jenkins-hbase4:34279] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-23 15:06:51,732 INFO [RS:0;jenkins-hbase4:34279] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-23 15:06:51,732 INFO [RS:0;jenkins-hbase4:34279] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-23 15:06:51,753 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39285,DS-70414d91-22bc-4c37-9f69-1066c869fc70,DISK] 2023-07-23 15:06:51,754 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41261,DS-bc86a2ee-c419-4e5c-aff1-16bee4bd845b,DISK] 2023-07-23 15:06:51,780 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35053,DS-99495c4c-cece-4766-bd40-dee655ab8e7e,DISK] 2023-07-23 15:06:51,797 INFO [RS:2;jenkins-hbase4:46191] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46191%2C1690124809654, suffix=, logDir=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/WALs/jenkins-hbase4.apache.org,46191,1690124809654, archiveDir=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/oldWALs, maxLogs=32 2023-07-23 15:06:51,813 DEBUG [jenkins-hbase4:38379] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-23 15:06:51,819 INFO [RS:1;jenkins-hbase4:46239] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/WALs/jenkins-hbase4.apache.org,46239,1690124809597/jenkins-hbase4.apache.org%2C46239%2C1690124809597.1690124811725 2023-07-23 15:06:51,819 DEBUG [jenkins-hbase4:38379] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-23 15:06:51,820 DEBUG [RS:1;jenkins-hbase4:46239] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39285,DS-70414d91-22bc-4c37-9f69-1066c869fc70,DISK], DatanodeInfoWithStorage[127.0.0.1:35053,DS-99495c4c-cece-4766-bd40-dee655ab8e7e,DISK], DatanodeInfoWithStorage[127.0.0.1:41261,DS-bc86a2ee-c419-4e5c-aff1-16bee4bd845b,DISK]] 2023-07-23 15:06:51,829 DEBUG [jenkins-hbase4:38379] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-23 15:06:51,829 DEBUG [jenkins-hbase4:38379] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-23 15:06:51,829 DEBUG [jenkins-hbase4:38379] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-23 15:06:51,829 DEBUG [jenkins-hbase4:38379] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-23 15:06:51,835 INFO [RS:0;jenkins-hbase4:34279] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34279%2C1690124809505, suffix=, logDir=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/WALs/jenkins-hbase4.apache.org,34279,1690124809505, archiveDir=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/oldWALs, maxLogs=32 2023-07-23 15:06:51,857 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,34279,1690124809505, state=OPENING 2023-07-23 15:06:51,863 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41261,DS-bc86a2ee-c419-4e5c-aff1-16bee4bd845b,DISK] 2023-07-23 15:06:51,864 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39285,DS-70414d91-22bc-4c37-9f69-1066c869fc70,DISK] 2023-07-23 15:06:51,870 DEBUG [PEWorker-5] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-23 15:06:51,871 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35053,DS-99495c4c-cece-4766-bd40-dee655ab8e7e,DISK] 2023-07-23 15:06:51,884 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 15:06:51,885 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-23 15:06:51,889 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,34279,1690124809505}] 2023-07-23 15:06:51,924 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35053,DS-99495c4c-cece-4766-bd40-dee655ab8e7e,DISK] 2023-07-23 15:06:51,924 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41261,DS-bc86a2ee-c419-4e5c-aff1-16bee4bd845b,DISK] 2023-07-23 15:06:51,924 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39285,DS-70414d91-22bc-4c37-9f69-1066c869fc70,DISK] 2023-07-23 15:06:51,925 INFO [RS:2;jenkins-hbase4:46191] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/WALs/jenkins-hbase4.apache.org,46191,1690124809654/jenkins-hbase4.apache.org%2C46191%2C1690124809654.1690124811812 2023-07-23 15:06:51,930 DEBUG [RS:2;jenkins-hbase4:46191] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41261,DS-bc86a2ee-c419-4e5c-aff1-16bee4bd845b,DISK], DatanodeInfoWithStorage[127.0.0.1:39285,DS-70414d91-22bc-4c37-9f69-1066c869fc70,DISK], DatanodeInfoWithStorage[127.0.0.1:35053,DS-99495c4c-cece-4766-bd40-dee655ab8e7e,DISK]] 2023-07-23 15:06:51,937 INFO [RS:0;jenkins-hbase4:34279] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/WALs/jenkins-hbase4.apache.org,34279,1690124809505/jenkins-hbase4.apache.org%2C34279%2C1690124809505.1690124811837 2023-07-23 15:06:51,941 DEBUG [RS:0;jenkins-hbase4:34279] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39285,DS-70414d91-22bc-4c37-9f69-1066c869fc70,DISK], DatanodeInfoWithStorage[127.0.0.1:35053,DS-99495c4c-cece-4766-bd40-dee655ab8e7e,DISK], DatanodeInfoWithStorage[127.0.0.1:41261,DS-bc86a2ee-c419-4e5c-aff1-16bee4bd845b,DISK]] 2023-07-23 15:06:52,108 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:06:52,110 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-23 15:06:52,114 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38110, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-23 15:06:52,129 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-23 15:06:52,129 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-23 15:06:52,133 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34279%2C1690124809505.meta, suffix=.meta, logDir=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/WALs/jenkins-hbase4.apache.org,34279,1690124809505, archiveDir=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/oldWALs, maxLogs=32 2023-07-23 15:06:52,165 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35053,DS-99495c4c-cece-4766-bd40-dee655ab8e7e,DISK] 2023-07-23 15:06:52,167 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41261,DS-bc86a2ee-c419-4e5c-aff1-16bee4bd845b,DISK] 2023-07-23 15:06:52,167 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39285,DS-70414d91-22bc-4c37-9f69-1066c869fc70,DISK] 2023-07-23 15:06:52,181 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/WALs/jenkins-hbase4.apache.org,34279,1690124809505/jenkins-hbase4.apache.org%2C34279%2C1690124809505.meta.1690124812135.meta 2023-07-23 15:06:52,182 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35053,DS-99495c4c-cece-4766-bd40-dee655ab8e7e,DISK], DatanodeInfoWithStorage[127.0.0.1:41261,DS-bc86a2ee-c419-4e5c-aff1-16bee4bd845b,DISK], DatanodeInfoWithStorage[127.0.0.1:39285,DS-70414d91-22bc-4c37-9f69-1066c869fc70,DISK]] 2023-07-23 15:06:52,183 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-23 15:06:52,184 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-23 15:06:52,186 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 15:06:52,187 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-23 15:06:52,194 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-23 15:06:52,196 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-23 15:06:52,215 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-23 15:06:52,215 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:06:52,215 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-23 15:06:52,215 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-23 15:06:52,219 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-23 15:06:52,223 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/hbase/meta/1588230740/info 2023-07-23 15:06:52,223 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/hbase/meta/1588230740/info 2023-07-23 15:06:52,223 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-23 15:06:52,224 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 15:06:52,225 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-23 15:06:52,226 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/hbase/meta/1588230740/rep_barrier 2023-07-23 15:06:52,226 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/hbase/meta/1588230740/rep_barrier 2023-07-23 15:06:52,227 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-23 15:06:52,228 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 15:06:52,228 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-23 15:06:52,230 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/hbase/meta/1588230740/table 2023-07-23 15:06:52,230 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/hbase/meta/1588230740/table 2023-07-23 15:06:52,231 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-23 15:06:52,231 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 15:06:52,233 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/hbase/meta/1588230740 2023-07-23 15:06:52,239 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/hbase/meta/1588230740 2023-07-23 15:06:52,243 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-23 15:06:52,246 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-23 15:06:52,248 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71594477, jitterRate=0.06684084236621857}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-23 15:06:52,258 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-23 15:06:52,277 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1690124812100 2023-07-23 15:06:52,299 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-23 15:06:52,300 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-23 15:06:52,301 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,34279,1690124809505, state=OPEN 2023-07-23 15:06:52,304 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-23 15:06:52,304 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-23 15:06:52,309 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-23 15:06:52,310 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,34279,1690124809505 in 416 msec 2023-07-23 15:06:52,318 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-23 15:06:52,318 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 690 msec 2023-07-23 15:06:52,329 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.3100 sec 2023-07-23 15:06:52,329 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1690124812329, completionTime=-1 2023-07-23 15:06:52,330 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-23 15:06:52,330 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-23 15:06:52,415 DEBUG [hconnection-0x3d9205bb-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:06:52,425 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38118, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:06:52,450 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-23 15:06:52,450 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1690124872450 2023-07-23 15:06:52,450 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1690124932450 2023-07-23 15:06:52,450 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 120 msec 2023-07-23 15:06:52,479 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38379,1690124807983-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-23 15:06:52,480 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38379,1690124807983-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-23 15:06:52,480 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38379,1690124807983-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-23 15:06:52,482 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:38379, period=300000, unit=MILLISECONDS is enabled. 2023-07-23 15:06:52,482 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-23 15:06:52,492 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-23 15:06:52,499 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-23 15:06:52,501 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-23 15:06:52,511 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-23 15:06:52,514 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-23 15:06:52,517 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-23 15:06:52,539 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/hbase/namespace/3ed886b7153b08dda7c0db040555d90b 2023-07-23 15:06:52,542 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/hbase/namespace/3ed886b7153b08dda7c0db040555d90b empty. 2023-07-23 15:06:52,543 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/hbase/namespace/3ed886b7153b08dda7c0db040555d90b 2023-07-23 15:06:52,543 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-23 15:06:52,603 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-23 15:06:52,606 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 3ed886b7153b08dda7c0db040555d90b, NAME => 'hbase:namespace,,1690124812500.3ed886b7153b08dda7c0db040555d90b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp 2023-07-23 15:06:52,624 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1690124812500.3ed886b7153b08dda7c0db040555d90b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:06:52,624 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 3ed886b7153b08dda7c0db040555d90b, disabling compactions & flushes 2023-07-23 15:06:52,624 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1690124812500.3ed886b7153b08dda7c0db040555d90b. 2023-07-23 15:06:52,624 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1690124812500.3ed886b7153b08dda7c0db040555d90b. 2023-07-23 15:06:52,624 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1690124812500.3ed886b7153b08dda7c0db040555d90b. after waiting 0 ms 2023-07-23 15:06:52,624 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1690124812500.3ed886b7153b08dda7c0db040555d90b. 2023-07-23 15:06:52,625 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1690124812500.3ed886b7153b08dda7c0db040555d90b. 2023-07-23 15:06:52,625 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 3ed886b7153b08dda7c0db040555d90b: 2023-07-23 15:06:52,630 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-23 15:06:52,646 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1690124812500.3ed886b7153b08dda7c0db040555d90b.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690124812633"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690124812633"}]},"ts":"1690124812633"} 2023-07-23 15:06:52,687 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-23 15:06:52,689 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-23 15:06:52,694 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690124812690"}]},"ts":"1690124812690"} 2023-07-23 15:06:52,704 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-23 15:06:52,708 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-23 15:06:52,710 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-23 15:06:52,710 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-23 15:06:52,710 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-23 15:06:52,710 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-23 15:06:52,713 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=3ed886b7153b08dda7c0db040555d90b, ASSIGN}] 2023-07-23 15:06:52,724 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=3ed886b7153b08dda7c0db040555d90b, ASSIGN 2023-07-23 15:06:52,726 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=3ed886b7153b08dda7c0db040555d90b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46191,1690124809654; forceNewPlan=false, retain=false 2023-07-23 15:06:52,879 INFO [jenkins-hbase4:38379] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-23 15:06:52,880 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=3ed886b7153b08dda7c0db040555d90b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:06:52,881 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1690124812500.3ed886b7153b08dda7c0db040555d90b.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690124812880"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690124812880"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690124812880"}]},"ts":"1690124812880"} 2023-07-23 15:06:52,884 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 3ed886b7153b08dda7c0db040555d90b, server=jenkins-hbase4.apache.org,46191,1690124809654}] 2023-07-23 15:06:53,040 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:06:53,040 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-23 15:06:53,043 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32848, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-23 15:06:53,049 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1690124812500.3ed886b7153b08dda7c0db040555d90b. 2023-07-23 15:06:53,049 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3ed886b7153b08dda7c0db040555d90b, NAME => 'hbase:namespace,,1690124812500.3ed886b7153b08dda7c0db040555d90b.', STARTKEY => '', ENDKEY => ''} 2023-07-23 15:06:53,049 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1690124812500.3ed886b7153b08dda7c0db040555d90b. service=AccessControlService 2023-07-23 15:06:53,050 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 15:06:53,050 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 3ed886b7153b08dda7c0db040555d90b 2023-07-23 15:06:53,051 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1690124812500.3ed886b7153b08dda7c0db040555d90b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:06:53,051 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3ed886b7153b08dda7c0db040555d90b 2023-07-23 15:06:53,051 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3ed886b7153b08dda7c0db040555d90b 2023-07-23 15:06:53,053 INFO [StoreOpener-3ed886b7153b08dda7c0db040555d90b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 3ed886b7153b08dda7c0db040555d90b 2023-07-23 15:06:53,055 DEBUG [StoreOpener-3ed886b7153b08dda7c0db040555d90b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/hbase/namespace/3ed886b7153b08dda7c0db040555d90b/info 2023-07-23 15:06:53,055 DEBUG [StoreOpener-3ed886b7153b08dda7c0db040555d90b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/hbase/namespace/3ed886b7153b08dda7c0db040555d90b/info 2023-07-23 15:06:53,056 INFO [StoreOpener-3ed886b7153b08dda7c0db040555d90b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3ed886b7153b08dda7c0db040555d90b columnFamilyName info 2023-07-23 15:06:53,057 INFO [StoreOpener-3ed886b7153b08dda7c0db040555d90b-1] regionserver.HStore(310): Store=3ed886b7153b08dda7c0db040555d90b/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 15:06:53,059 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/hbase/namespace/3ed886b7153b08dda7c0db040555d90b 2023-07-23 15:06:53,059 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/hbase/namespace/3ed886b7153b08dda7c0db040555d90b 2023-07-23 15:06:53,063 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3ed886b7153b08dda7c0db040555d90b 2023-07-23 15:06:53,067 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/hbase/namespace/3ed886b7153b08dda7c0db040555d90b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 15:06:53,068 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3ed886b7153b08dda7c0db040555d90b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70320504, jitterRate=0.04785716533660889}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 15:06:53,068 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3ed886b7153b08dda7c0db040555d90b: 2023-07-23 15:06:53,072 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1690124812500.3ed886b7153b08dda7c0db040555d90b., pid=6, masterSystemTime=1690124813040 2023-07-23 15:06:53,076 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1690124812500.3ed886b7153b08dda7c0db040555d90b. 2023-07-23 15:06:53,076 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1690124812500.3ed886b7153b08dda7c0db040555d90b. 2023-07-23 15:06:53,077 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=3ed886b7153b08dda7c0db040555d90b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:06:53,078 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1690124812500.3ed886b7153b08dda7c0db040555d90b.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690124813077"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690124813077"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690124813077"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690124813077"}]},"ts":"1690124813077"} 2023-07-23 15:06:53,087 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-23 15:06:53,087 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 3ed886b7153b08dda7c0db040555d90b, server=jenkins-hbase4.apache.org,46191,1690124809654 in 199 msec 2023-07-23 15:06:53,092 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-23 15:06:53,093 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=3ed886b7153b08dda7c0db040555d90b, ASSIGN in 374 msec 2023-07-23 15:06:53,094 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-23 15:06:53,094 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690124813094"}]},"ts":"1690124813094"} 2023-07-23 15:06:53,097 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-23 15:06:53,101 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-23 15:06:53,104 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 599 msec 2023-07-23 15:06:53,114 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-23 15:06:53,115 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-23 15:06:53,115 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 15:06:53,141 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:06:53,142 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32856, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:06:53,161 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-23 15:06:53,178 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-23 15:06:53,184 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 34 msec 2023-07-23 15:06:53,194 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-23 15:06:53,209 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-23 15:06:53,215 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 20 msec 2023-07-23 15:06:53,231 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-23 15:06:53,235 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-23 15:06:53,235 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.503sec 2023-07-23 15:06:53,238 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-23 15:06:53,240 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-23 15:06:53,240 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-23 15:06:53,242 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38379,1690124807983-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-23 15:06:53,243 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38379,1690124807983-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-23 15:06:53,266 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-23 15:06:53,268 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-23 15:06:53,270 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-23 15:06:53,273 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-23 15:06:53,275 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-23 15:06:53,276 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/hbase/acl/0de123eef788e5c0b4e3e20b5a4d6732 2023-07-23 15:06:53,277 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/hbase/acl/0de123eef788e5c0b4e3e20b5a4d6732 empty. 2023-07-23 15:06:53,280 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/hbase/acl/0de123eef788e5c0b4e3e20b5a4d6732 2023-07-23 15:06:53,280 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-23 15:06:53,284 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-23 15:06:53,308 DEBUG [Listener at localhost/36099] zookeeper.ReadOnlyZKClient(139): Connect 0x2f8c14a3 to 127.0.0.1:51019 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 15:06:53,315 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-23 15:06:53,315 DEBUG [Listener at localhost/36099] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7051d77a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 15:06:53,317 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0de123eef788e5c0b4e3e20b5a4d6732, NAME => 'hbase:acl,,1690124813261.0de123eef788e5c0b4e3e20b5a4d6732.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp 2023-07-23 15:06:53,341 DEBUG [hconnection-0x59bfdb6e-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:06:53,370 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1690124813261.0de123eef788e5c0b4e3e20b5a4d6732.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:06:53,371 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 0de123eef788e5c0b4e3e20b5a4d6732, disabling compactions & flushes 2023-07-23 15:06:53,371 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1690124813261.0de123eef788e5c0b4e3e20b5a4d6732. 2023-07-23 15:06:53,371 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1690124813261.0de123eef788e5c0b4e3e20b5a4d6732. 2023-07-23 15:06:53,371 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1690124813261.0de123eef788e5c0b4e3e20b5a4d6732. after waiting 0 ms 2023-07-23 15:06:53,371 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1690124813261.0de123eef788e5c0b4e3e20b5a4d6732. 2023-07-23 15:06:53,371 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1690124813261.0de123eef788e5c0b4e3e20b5a4d6732. 2023-07-23 15:06:53,371 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 0de123eef788e5c0b4e3e20b5a4d6732: 2023-07-23 15:06:53,372 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38134, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:06:53,375 INFO [Listener at localhost/36099] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,38379,1690124807983 2023-07-23 15:06:53,376 INFO [Listener at localhost/36099] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-23 15:06:53,376 INFO [Listener at localhost/36099] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/test.cache.data in system properties and HBase conf 2023-07-23 15:06:53,376 INFO [Listener at localhost/36099] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/hadoop.tmp.dir in system properties and HBase conf 2023-07-23 15:06:53,376 INFO [Listener at localhost/36099] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/hadoop.log.dir in system properties and HBase conf 2023-07-23 15:06:53,376 INFO [Listener at localhost/36099] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-23 15:06:53,376 INFO [Listener at localhost/36099] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-23 15:06:53,376 INFO [Listener at localhost/36099] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-23 15:06:53,377 INFO [Listener at localhost/36099] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-23 15:06:53,377 INFO [Listener at localhost/36099] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-23 15:06:53,377 INFO [Listener at localhost/36099] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-23 15:06:53,377 INFO [Listener at localhost/36099] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-23 15:06:53,377 INFO [Listener at localhost/36099] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-23 15:06:53,377 INFO [Listener at localhost/36099] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-23 15:06:53,378 INFO [Listener at localhost/36099] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-23 15:06:53,378 INFO [Listener at localhost/36099] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-23 15:06:53,378 INFO [Listener at localhost/36099] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-23 15:06:53,378 INFO [Listener at localhost/36099] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/nfs.dump.dir in system properties and HBase conf 2023-07-23 15:06:53,378 INFO [Listener at localhost/36099] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/java.io.tmpdir in system properties and HBase conf 2023-07-23 15:06:53,378 INFO [Listener at localhost/36099] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-23 15:06:53,378 INFO [Listener at localhost/36099] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-23 15:06:53,378 INFO [Listener at localhost/36099] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-23 15:06:53,381 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-23 15:06:53,382 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1690124813261.0de123eef788e5c0b4e3e20b5a4d6732.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690124813382"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690124813382"}]},"ts":"1690124813382"} 2023-07-23 15:06:53,385 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-23 15:06:53,388 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-23 15:06:53,388 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690124813388"}]},"ts":"1690124813388"} 2023-07-23 15:06:53,388 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-23 15:06:53,392 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-23 15:06:53,398 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-23 15:06:53,399 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-23 15:06:53,400 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-23 15:06:53,400 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-23 15:06:53,400 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-23 15:06:53,400 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=0de123eef788e5c0b4e3e20b5a4d6732, ASSIGN}] 2023-07-23 15:06:53,404 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=0de123eef788e5c0b4e3e20b5a4d6732, ASSIGN 2023-07-23 15:06:53,407 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=0de123eef788e5c0b4e3e20b5a4d6732, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34279,1690124809505; forceNewPlan=false, retain=false 2023-07-23 15:06:53,557 INFO [jenkins-hbase4:38379] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-23 15:06:53,559 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=0de123eef788e5c0b4e3e20b5a4d6732, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:06:53,559 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1690124813261.0de123eef788e5c0b4e3e20b5a4d6732.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690124813558"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690124813558"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690124813558"}]},"ts":"1690124813558"} 2023-07-23 15:06:53,563 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 0de123eef788e5c0b4e3e20b5a4d6732, server=jenkins-hbase4.apache.org,34279,1690124809505}] 2023-07-23 15:06:53,589 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-23 15:06:53,726 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1690124813261.0de123eef788e5c0b4e3e20b5a4d6732. 2023-07-23 15:06:53,726 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0de123eef788e5c0b4e3e20b5a4d6732, NAME => 'hbase:acl,,1690124813261.0de123eef788e5c0b4e3e20b5a4d6732.', STARTKEY => '', ENDKEY => ''} 2023-07-23 15:06:53,727 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1690124813261.0de123eef788e5c0b4e3e20b5a4d6732. service=AccessControlService 2023-07-23 15:06:53,727 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 15:06:53,727 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 0de123eef788e5c0b4e3e20b5a4d6732 2023-07-23 15:06:53,727 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1690124813261.0de123eef788e5c0b4e3e20b5a4d6732.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:06:53,728 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0de123eef788e5c0b4e3e20b5a4d6732 2023-07-23 15:06:53,728 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0de123eef788e5c0b4e3e20b5a4d6732 2023-07-23 15:06:53,750 INFO [StoreOpener-0de123eef788e5c0b4e3e20b5a4d6732-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 0de123eef788e5c0b4e3e20b5a4d6732 2023-07-23 15:06:53,755 DEBUG [StoreOpener-0de123eef788e5c0b4e3e20b5a4d6732-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/hbase/acl/0de123eef788e5c0b4e3e20b5a4d6732/l 2023-07-23 15:06:53,755 DEBUG [StoreOpener-0de123eef788e5c0b4e3e20b5a4d6732-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/hbase/acl/0de123eef788e5c0b4e3e20b5a4d6732/l 2023-07-23 15:06:53,756 INFO [StoreOpener-0de123eef788e5c0b4e3e20b5a4d6732-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0de123eef788e5c0b4e3e20b5a4d6732 columnFamilyName l 2023-07-23 15:06:53,760 INFO [StoreOpener-0de123eef788e5c0b4e3e20b5a4d6732-1] regionserver.HStore(310): Store=0de123eef788e5c0b4e3e20b5a4d6732/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 15:06:53,762 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/hbase/acl/0de123eef788e5c0b4e3e20b5a4d6732 2023-07-23 15:06:53,764 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/hbase/acl/0de123eef788e5c0b4e3e20b5a4d6732 2023-07-23 15:06:53,771 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0de123eef788e5c0b4e3e20b5a4d6732 2023-07-23 15:06:53,782 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/hbase/acl/0de123eef788e5c0b4e3e20b5a4d6732/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 15:06:53,783 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0de123eef788e5c0b4e3e20b5a4d6732; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65958934, jitterRate=-0.017135292291641235}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 15:06:53,784 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0de123eef788e5c0b4e3e20b5a4d6732: 2023-07-23 15:06:53,786 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1690124813261.0de123eef788e5c0b4e3e20b5a4d6732., pid=11, masterSystemTime=1690124813716 2023-07-23 15:06:53,791 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=0de123eef788e5c0b4e3e20b5a4d6732, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:06:53,791 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1690124813261.0de123eef788e5c0b4e3e20b5a4d6732.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690124813791"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690124813791"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690124813791"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690124813791"}]},"ts":"1690124813791"} 2023-07-23 15:06:53,797 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1690124813261.0de123eef788e5c0b4e3e20b5a4d6732. 2023-07-23 15:06:53,797 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1690124813261.0de123eef788e5c0b4e3e20b5a4d6732. 2023-07-23 15:06:53,799 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-23 15:06:53,800 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 0de123eef788e5c0b4e3e20b5a4d6732, server=jenkins-hbase4.apache.org,34279,1690124809505 in 232 msec 2023-07-23 15:06:53,805 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-23 15:06:53,806 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=0de123eef788e5c0b4e3e20b5a4d6732, ASSIGN in 400 msec 2023-07-23 15:06:53,810 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-23 15:06:53,810 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690124813810"}]},"ts":"1690124813810"} 2023-07-23 15:06:53,813 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-23 15:06:53,817 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-23 15:06:53,821 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 552 msec 2023-07-23 15:06:53,889 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-23 15:06:53,889 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-23 15:06:53,919 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-23 15:06:54,823 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-23 15:06:55,113 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-07-23 15:06:55,118 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_39789_jobhistory____jdxlvf/webapp 2023-07-23 15:06:55,291 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-23 15:06:55,291 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-23 15:06:55,291 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-23 15:06:55,294 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-23 15:06:55,357 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 15:06:55,614 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 15:06:56,003 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-23 15:06:56,060 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:39789 2023-07-23 15:06:56,319 WARN [Listener at jenkins-hbase4.apache.org/35059] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-23 15:06:56,730 WARN [Listener at jenkins-hbase4.apache.org/35059] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-23 15:06:56,730 INFO [Listener at jenkins-hbase4.apache.org/35059] log.Slf4jLog(67): jetty-6.1.26 2023-07-23 15:06:56,741 INFO [Listener at jenkins-hbase4.apache.org/35059] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_44579_cluster____a0hq7h/webapp 2023-07-23 15:06:56,821 INFO [Listener at jenkins-hbase4.apache.org/35059] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-23 15:06:56,821 INFO [Listener at jenkins-hbase4.apache.org/35059] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-23 15:06:56,822 INFO [Listener at jenkins-hbase4.apache.org/35059] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-23 15:06:56,822 INFO [Listener at jenkins-hbase4.apache.org/35059] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-23 15:06:56,834 INFO [Listener at jenkins-hbase4.apache.org/35059] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 15:06:57,100 INFO [Listener at jenkins-hbase4.apache.org/35059] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 15:06:57,325 INFO [Listener at jenkins-hbase4.apache.org/35059] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 15:06:57,379 INFO [Listener at jenkins-hbase4.apache.org/35059] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:44579 2023-07-23 15:06:57,954 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-23 15:06:58,039 WARN [Listener at jenkins-hbase4.apache.org/40499] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-23 15:06:58,077 WARN [Listener at jenkins-hbase4.apache.org/40499] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-23 15:06:58,078 INFO [Listener at jenkins-hbase4.apache.org/40499] log.Slf4jLog(67): jetty-6.1.26 2023-07-23 15:06:58,095 INFO [Listener at jenkins-hbase4.apache.org/40499] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_38701_node____.r2x13j/webapp 2023-07-23 15:06:58,125 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-23 15:06:58,131 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-23 15:06:58,132 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-23 15:06:58,167 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 15:06:58,167 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-23 15:06:58,168 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 15:06:58,168 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-23 15:06:58,168 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-23 15:06:58,168 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-23 15:06:58,169 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 15:06:58,169 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-23 15:06:58,169 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-23 15:06:58,169 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-23 15:06:58,196 INFO [Listener at jenkins-hbase4.apache.org/40499] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-23 15:06:58,196 INFO [Listener at jenkins-hbase4.apache.org/40499] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-23 15:06:58,197 INFO [Listener at jenkins-hbase4.apache.org/40499] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-23 15:06:58,197 INFO [Listener at jenkins-hbase4.apache.org/40499] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-23 15:06:58,208 INFO [Listener at jenkins-hbase4.apache.org/40499] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 15:06:58,226 INFO [Listener at jenkins-hbase4.apache.org/40499] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 15:06:58,310 INFO [Listener at jenkins-hbase4.apache.org/40499] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 15:06:58,326 INFO [Listener at jenkins-hbase4.apache.org/40499] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:38701 2023-07-23 15:06:58,532 WARN [Listener at jenkins-hbase4.apache.org/33035] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-23 15:06:58,541 WARN [Listener at jenkins-hbase4.apache.org/33035] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-23 15:06:58,542 INFO [Listener at jenkins-hbase4.apache.org/33035] log.Slf4jLog(67): jetty-6.1.26 2023-07-23 15:06:58,554 INFO [Listener at jenkins-hbase4.apache.org/33035] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_40891_node____y2yb2q/webapp 2023-07-23 15:06:58,626 INFO [Listener at jenkins-hbase4.apache.org/33035] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-23 15:06:58,626 INFO [Listener at jenkins-hbase4.apache.org/33035] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-23 15:06:58,627 INFO [Listener at jenkins-hbase4.apache.org/33035] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-23 15:06:58,627 INFO [Listener at jenkins-hbase4.apache.org/33035] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-23 15:06:58,637 INFO [Listener at jenkins-hbase4.apache.org/33035] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 15:06:58,657 INFO [Listener at jenkins-hbase4.apache.org/33035] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 15:06:58,754 INFO [Listener at jenkins-hbase4.apache.org/33035] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 15:06:58,764 INFO [Listener at jenkins-hbase4.apache.org/33035] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:40891 2023-07-23 15:06:58,787 INFO [Listener at jenkins-hbase4.apache.org/33035] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-23 15:06:58,789 INFO [Listener at jenkins-hbase4.apache.org/33035] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 15:06:58,884 INFO [Listener at jenkins-hbase4.apache.org/33035] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=708, OpenFileDescriptor=898, MaxFileDescriptor=60000, SystemLoadAverage=111, ProcessCount=173, AvailableMemoryMB=8332 2023-07-23 15:06:58,884 WARN [Listener at jenkins-hbase4.apache.org/33035] hbase.ResourceChecker(130): Thread=708 is superior to 500 2023-07-23 15:06:58,899 DEBUG [Listener at jenkins-hbase4.apache.org/33035] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-23 15:06:58,908 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44990, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-23 15:06:58,916 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-23 15:06:58,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-23 15:06:58,922 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-23 15:06:58,922 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-23 15:06:58,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-23 15:06:58,924 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-23 15:06:58,930 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportWithTargetName/ae5bb88779130c4fe430937f66e867b9 2023-07-23 15:06:58,930 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportWithTargetName/5e5d49986d647575b175db080ff1c99f 2023-07-23 15:06:58,932 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportWithTargetName/ae5bb88779130c4fe430937f66e867b9 empty. 2023-07-23 15:06:58,932 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportWithTargetName/5e5d49986d647575b175db080ff1c99f empty. 2023-07-23 15:06:58,932 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportWithTargetName/ae5bb88779130c4fe430937f66e867b9 2023-07-23 15:06:58,936 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportWithTargetName/5e5d49986d647575b175db080ff1c99f 2023-07-23 15:06:58,936 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-23 15:06:58,967 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-23 15:06:58,971 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => ae5bb88779130c4fe430937f66e867b9, NAME => 'testtb-testExportWithTargetName,,1690124818915.ae5bb88779130c4fe430937f66e867b9.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp 2023-07-23 15:06:58,971 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 5e5d49986d647575b175db080ff1c99f, NAME => 'testtb-testExportWithTargetName,1,1690124818915.5e5d49986d647575b175db080ff1c99f.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp 2023-07-23 15:06:59,012 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1690124818915.ae5bb88779130c4fe430937f66e867b9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:06:59,013 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing ae5bb88779130c4fe430937f66e867b9, disabling compactions & flushes 2023-07-23 15:06:59,013 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1690124818915.ae5bb88779130c4fe430937f66e867b9. 2023-07-23 15:06:59,013 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1690124818915.ae5bb88779130c4fe430937f66e867b9. 2023-07-23 15:06:59,013 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1690124818915.ae5bb88779130c4fe430937f66e867b9. after waiting 0 ms 2023-07-23 15:06:59,013 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1690124818915.ae5bb88779130c4fe430937f66e867b9. 2023-07-23 15:06:59,014 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1690124818915.ae5bb88779130c4fe430937f66e867b9. 2023-07-23 15:06:59,014 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for ae5bb88779130c4fe430937f66e867b9: 2023-07-23 15:06:59,018 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1690124818915.5e5d49986d647575b175db080ff1c99f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:06:59,019 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 5e5d49986d647575b175db080ff1c99f, disabling compactions & flushes 2023-07-23 15:06:59,019 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1690124818915.5e5d49986d647575b175db080ff1c99f. 2023-07-23 15:06:59,019 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1690124818915.5e5d49986d647575b175db080ff1c99f. 2023-07-23 15:06:59,019 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1690124818915.5e5d49986d647575b175db080ff1c99f. after waiting 0 ms 2023-07-23 15:06:59,019 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1690124818915.5e5d49986d647575b175db080ff1c99f. 2023-07-23 15:06:59,019 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1690124818915.5e5d49986d647575b175db080ff1c99f. 2023-07-23 15:06:59,019 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 5e5d49986d647575b175db080ff1c99f: 2023-07-23 15:06:59,024 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-23 15:06:59,025 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1690124818915.ae5bb88779130c4fe430937f66e867b9.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690124819025"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690124819025"}]},"ts":"1690124819025"} 2023-07-23 15:06:59,026 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1690124818915.5e5d49986d647575b175db080ff1c99f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690124819025"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690124819025"}]},"ts":"1690124819025"} 2023-07-23 15:06:59,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-23 15:06:59,082 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-23 15:06:59,084 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-23 15:06:59,084 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690124819084"}]},"ts":"1690124819084"} 2023-07-23 15:06:59,087 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-23 15:06:59,098 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-23 15:06:59,100 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-23 15:06:59,100 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-23 15:06:59,100 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-23 15:06:59,100 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-23 15:06:59,100 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ae5bb88779130c4fe430937f66e867b9, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5e5d49986d647575b175db080ff1c99f, ASSIGN}] 2023-07-23 15:06:59,105 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5e5d49986d647575b175db080ff1c99f, ASSIGN 2023-07-23 15:06:59,105 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ae5bb88779130c4fe430937f66e867b9, ASSIGN 2023-07-23 15:06:59,107 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5e5d49986d647575b175db080ff1c99f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34279,1690124809505; forceNewPlan=false, retain=false 2023-07-23 15:06:59,107 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ae5bb88779130c4fe430937f66e867b9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46239,1690124809597; forceNewPlan=false, retain=false 2023-07-23 15:06:59,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-23 15:06:59,257 INFO [jenkins-hbase4:38379] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-23 15:06:59,260 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=ae5bb88779130c4fe430937f66e867b9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:06:59,260 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=5e5d49986d647575b175db080ff1c99f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:06:59,260 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1690124818915.ae5bb88779130c4fe430937f66e867b9.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690124819260"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690124819260"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690124819260"}]},"ts":"1690124819260"} 2023-07-23 15:06:59,260 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1690124818915.5e5d49986d647575b175db080ff1c99f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690124819260"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690124819260"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690124819260"}]},"ts":"1690124819260"} 2023-07-23 15:06:59,263 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure ae5bb88779130c4fe430937f66e867b9, server=jenkins-hbase4.apache.org,46239,1690124809597}] 2023-07-23 15:06:59,265 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure 5e5d49986d647575b175db080ff1c99f, server=jenkins-hbase4.apache.org,34279,1690124809505}] 2023-07-23 15:06:59,418 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:06:59,418 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-23 15:06:59,423 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43506, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-23 15:06:59,431 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1690124818915.ae5bb88779130c4fe430937f66e867b9. 2023-07-23 15:06:59,431 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1690124818915.5e5d49986d647575b175db080ff1c99f. 2023-07-23 15:06:59,431 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ae5bb88779130c4fe430937f66e867b9, NAME => 'testtb-testExportWithTargetName,,1690124818915.ae5bb88779130c4fe430937f66e867b9.', STARTKEY => '', ENDKEY => '1'} 2023-07-23 15:06:59,431 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5e5d49986d647575b175db080ff1c99f, NAME => 'testtb-testExportWithTargetName,1,1690124818915.5e5d49986d647575b175db080ff1c99f.', STARTKEY => '1', ENDKEY => ''} 2023-07-23 15:06:59,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1690124818915.ae5bb88779130c4fe430937f66e867b9. service=AccessControlService 2023-07-23 15:06:59,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1690124818915.5e5d49986d647575b175db080ff1c99f. service=AccessControlService 2023-07-23 15:06:59,432 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 15:06:59,432 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 15:06:59,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName ae5bb88779130c4fe430937f66e867b9 2023-07-23 15:06:59,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 5e5d49986d647575b175db080ff1c99f 2023-07-23 15:06:59,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1690124818915.ae5bb88779130c4fe430937f66e867b9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:06:59,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1690124818915.5e5d49986d647575b175db080ff1c99f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:06:59,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ae5bb88779130c4fe430937f66e867b9 2023-07-23 15:06:59,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5e5d49986d647575b175db080ff1c99f 2023-07-23 15:06:59,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ae5bb88779130c4fe430937f66e867b9 2023-07-23 15:06:59,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5e5d49986d647575b175db080ff1c99f 2023-07-23 15:06:59,437 INFO [StoreOpener-ae5bb88779130c4fe430937f66e867b9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ae5bb88779130c4fe430937f66e867b9 2023-07-23 15:06:59,438 INFO [StoreOpener-5e5d49986d647575b175db080ff1c99f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5e5d49986d647575b175db080ff1c99f 2023-07-23 15:06:59,440 DEBUG [StoreOpener-ae5bb88779130c4fe430937f66e867b9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportWithTargetName/ae5bb88779130c4fe430937f66e867b9/cf 2023-07-23 15:06:59,440 DEBUG [StoreOpener-5e5d49986d647575b175db080ff1c99f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportWithTargetName/5e5d49986d647575b175db080ff1c99f/cf 2023-07-23 15:06:59,440 DEBUG [StoreOpener-ae5bb88779130c4fe430937f66e867b9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportWithTargetName/ae5bb88779130c4fe430937f66e867b9/cf 2023-07-23 15:06:59,440 DEBUG [StoreOpener-5e5d49986d647575b175db080ff1c99f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportWithTargetName/5e5d49986d647575b175db080ff1c99f/cf 2023-07-23 15:06:59,440 INFO [StoreOpener-ae5bb88779130c4fe430937f66e867b9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ae5bb88779130c4fe430937f66e867b9 columnFamilyName cf 2023-07-23 15:06:59,440 INFO [StoreOpener-5e5d49986d647575b175db080ff1c99f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5e5d49986d647575b175db080ff1c99f columnFamilyName cf 2023-07-23 15:06:59,442 INFO [StoreOpener-5e5d49986d647575b175db080ff1c99f-1] regionserver.HStore(310): Store=5e5d49986d647575b175db080ff1c99f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 15:06:59,450 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportWithTargetName/5e5d49986d647575b175db080ff1c99f 2023-07-23 15:06:59,451 INFO [StoreOpener-ae5bb88779130c4fe430937f66e867b9-1] regionserver.HStore(310): Store=ae5bb88779130c4fe430937f66e867b9/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 15:06:59,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportWithTargetName/5e5d49986d647575b175db080ff1c99f 2023-07-23 15:06:59,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportWithTargetName/ae5bb88779130c4fe430937f66e867b9 2023-07-23 15:06:59,453 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportWithTargetName/ae5bb88779130c4fe430937f66e867b9 2023-07-23 15:06:59,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5e5d49986d647575b175db080ff1c99f 2023-07-23 15:06:59,458 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ae5bb88779130c4fe430937f66e867b9 2023-07-23 15:06:59,464 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportWithTargetName/5e5d49986d647575b175db080ff1c99f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 15:06:59,466 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5e5d49986d647575b175db080ff1c99f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69177465, jitterRate=0.030824556946754456}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 15:06:59,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5e5d49986d647575b175db080ff1c99f: 2023-07-23 15:06:59,467 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportWithTargetName/ae5bb88779130c4fe430937f66e867b9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 15:06:59,471 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1690124818915.5e5d49986d647575b175db080ff1c99f., pid=16, masterSystemTime=1690124819418 2023-07-23 15:06:59,471 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ae5bb88779130c4fe430937f66e867b9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62520984, jitterRate=-0.06836473941802979}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 15:06:59,472 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ae5bb88779130c4fe430937f66e867b9: 2023-07-23 15:06:59,475 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1690124818915.ae5bb88779130c4fe430937f66e867b9., pid=15, masterSystemTime=1690124819418 2023-07-23 15:06:59,477 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1690124818915.5e5d49986d647575b175db080ff1c99f. 2023-07-23 15:06:59,477 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1690124818915.5e5d49986d647575b175db080ff1c99f. 2023-07-23 15:06:59,479 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=5e5d49986d647575b175db080ff1c99f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:06:59,479 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1690124818915.5e5d49986d647575b175db080ff1c99f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690124819479"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690124819479"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690124819479"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690124819479"}]},"ts":"1690124819479"} 2023-07-23 15:06:59,481 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=ae5bb88779130c4fe430937f66e867b9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:06:59,481 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1690124818915.ae5bb88779130c4fe430937f66e867b9. 2023-07-23 15:06:59,482 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1690124818915.ae5bb88779130c4fe430937f66e867b9. 2023-07-23 15:06:59,483 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1690124818915.ae5bb88779130c4fe430937f66e867b9.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690124819481"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690124819481"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690124819481"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690124819481"}]},"ts":"1690124819481"} 2023-07-23 15:06:59,491 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=13 2023-07-23 15:06:59,491 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=14 2023-07-23 15:06:59,492 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure ae5bb88779130c4fe430937f66e867b9, server=jenkins-hbase4.apache.org,46239,1690124809597 in 222 msec 2023-07-23 15:06:59,492 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure 5e5d49986d647575b175db080ff1c99f, server=jenkins-hbase4.apache.org,34279,1690124809505 in 219 msec 2023-07-23 15:06:59,494 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5e5d49986d647575b175db080ff1c99f, ASSIGN in 391 msec 2023-07-23 15:06:59,495 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-23 15:06:59,495 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ae5bb88779130c4fe430937f66e867b9, ASSIGN in 392 msec 2023-07-23 15:06:59,496 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-23 15:06:59,496 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690124819496"}]},"ts":"1690124819496"} 2023-07-23 15:06:59,498 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-23 15:06:59,502 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-23 15:06:59,507 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-23 15:06:59,525 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34279] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-23 15:06:59,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-23 15:06:59,559 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-23 15:06:59,559 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-23 15:06:59,559 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-23 15:06:59,560 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-23 15:06:59,559 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 15:06:59,568 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-23 15:06:59,568 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-23 15:06:59,568 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-23 15:06:59,568 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-23 15:06:59,572 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 653 msec 2023-07-23 15:07:00,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-23 15:07:00,032 INFO [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-23 15:07:00,032 DEBUG [Listener at jenkins-hbase4.apache.org/33035] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportWithTargetName get assigned. Timeout = 60000ms 2023-07-23 15:07:00,033 INFO [Listener at jenkins-hbase4.apache.org/33035] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 15:07:00,038 INFO [Listener at jenkins-hbase4.apache.org/33035] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportWithTargetName assigned to meta. Checking AM states. 2023-07-23 15:07:00,039 INFO [Listener at jenkins-hbase4.apache.org/33035] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 15:07:00,039 INFO [Listener at jenkins-hbase4.apache.org/33035] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportWithTargetName assigned. 2023-07-23 15:07:00,055 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-23 15:07:00,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690124820055 (current time:1690124820055). 2023-07-23 15:07:00,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 15:07:00,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] zookeeper.ReadOnlyZKClient(139): Connect 0x382a256c to 127.0.0.1:51019 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 15:07:00,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1f300d7a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 15:07:00,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:07:00,069 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38142, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:07:00,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x382a256c to 127.0.0.1:51019 2023-07-23 15:07:00,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 15:07:00,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] zookeeper.ReadOnlyZKClient(139): Connect 0x4ab5c5af to 127.0.0.1:51019 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 15:07:00,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@700c75c0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 15:07:00,081 DEBUG [hconnection-0x71582e07-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:07:00,085 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38156, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:07:00,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4ab5c5af to 127.0.0.1:51019 2023-07-23 15:07:00,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 15:07:00,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-23 15:07:00,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 15:07:00,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-23 15:07:00,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-23 15:07:00,146 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-23 15:07:00,148 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1690125420148 2023-07-23 15:07:00,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-23 15:07:00,154 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-23 15:07:00,157 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-23 15:07:00,159 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-23 15:07:00,161 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 21 msec 2023-07-23 15:07:00,162 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-23 15:07:00,163 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1690125420163 2023-07-23 15:07:00,165 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 15:07:00,165 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 15:07:00,236 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,236 INFO [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-23 15:07:00,236 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:07:00,237 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-23 15:07:00,237 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-23 15:07:00,238 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,238 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,243 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:07:00,243 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:07:00,243 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:07:00,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:07:00,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:07:00,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:07:00,243 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:00,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:07:00,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:07:00,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:07:00,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,244 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:00,244 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:00,244 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,244 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,245 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-23 15:07:00,245 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:00,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-23 15:07:00,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,245 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 15:07:00,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-23 15:07:00,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,246 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-23 15:07:00,246 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-23 15:07:00,246 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-23 15:07:00,252 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,265 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 15:07:00,266 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,267 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-23 15:07:00,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-23 15:07:00,270 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 15:07:00,280 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-23 15:07:00,280 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-23 15:07:00,280 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-23 15:07:00,280 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:07:00,280 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:07:00,280 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:07:00,282 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-23 15:07:00,282 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-23 15:07:00,282 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-23 15:07:00,281 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-23 15:07:00,283 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46239,1690124809597' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-23 15:07:00,282 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-23 15:07:00,283 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-23 15:07:00,283 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46191,1690124809654' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-23 15:07:00,283 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34279,1690124809505' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-23 15:07:00,287 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:00,287 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:00,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:07:00,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:07:00,291 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,291 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:00,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:07:00,291 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:07:00,291 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,291 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:07:00,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,292 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,292 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:07:00,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:00,292 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,292 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:07:00,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:00,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:00,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:07:00,294 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46239,1690124809597' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-23 15:07:00,294 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3ff7f659[Count = 1] remaining members to acquire global barrier 2023-07-23 15:07:00,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:00,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:07:00,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:07:00,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:07:00,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:07:00,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:00,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:00,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:00,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:07:00,300 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34279,1690124809505' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-23 15:07:00,300 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3ff7f659[Count = 0] remaining members to acquire global barrier 2023-07-23 15:07:00,300 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-23 15:07:00,302 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,305 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,305 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,305 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,306 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-23 15:07:00,306 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-23 15:07:00,306 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:00,306 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-23 15:07:00,306 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,46191,1690124809654' in zk 2023-07-23 15:07:00,307 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:00,307 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 15:07:00,310 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-23 15:07:00,315 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-23 15:07:00,315 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:07:00,315 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-23 15:07:00,318 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 15:07:00,319 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 15:07:00,319 DEBUG [rs(jenkins-hbase4.apache.org,34279,1690124809505)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1690124818915.5e5d49986d647575b175db080ff1c99f. 2023-07-23 15:07:00,319 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1690124818915.ae5bb88779130c4fe430937f66e867b9. 2023-07-23 15:07:00,319 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 15:07:00,321 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1690124818915.ae5bb88779130c4fe430937f66e867b9. started... 2023-07-23 15:07:00,321 DEBUG [rs(jenkins-hbase4.apache.org,34279,1690124809505)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1690124818915.5e5d49986d647575b175db080ff1c99f. started... 2023-07-23 15:07:00,321 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 15:07:00,325 DEBUG [rs(jenkins-hbase4.apache.org,34279,1690124809505)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5e5d49986d647575b175db080ff1c99f: 2023-07-23 15:07:00,325 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ae5bb88779130c4fe430937f66e867b9: 2023-07-23 15:07:00,326 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1690124818915.ae5bb88779130c4fe430937f66e867b9.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,326 DEBUG [rs(jenkins-hbase4.apache.org,34279,1690124809505)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1690124818915.5e5d49986d647575b175db080ff1c99f.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,334 DEBUG [rs(jenkins-hbase4.apache.org,34279,1690124809505)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 15:07:00,334 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 15:07:00,340 DEBUG [rs(jenkins-hbase4.apache.org,34279,1690124809505)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 15:07:00,340 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 15:07:00,384 DEBUG [rs(jenkins-hbase4.apache.org,34279,1690124809505)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1690124818915.5e5d49986d647575b175db080ff1c99f. completed. 2023-07-23 15:07:00,384 DEBUG [rs(jenkins-hbase4.apache.org,34279,1690124809505)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1690124818915.5e5d49986d647575b175db080ff1c99f. 2023-07-23 15:07:00,384 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 15:07:00,384 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 15:07:00,384 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:00,390 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-23 15:07:00,390 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,34279,1690124809505' in zk 2023-07-23 15:07:00,394 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:00,394 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-23 15:07:00,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:00,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:07:00,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:07:00,394 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:07:00,395 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-23 15:07:00,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:07:00,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:07:00,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:00,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:00,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:00,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:07:00,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,404 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1690124818915.ae5bb88779130c4fe430937f66e867b9. completed. 2023-07-23 15:07:00,405 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1690124818915.ae5bb88779130c4fe430937f66e867b9. 2023-07-23 15:07:00,405 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 15:07:00,405 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 15:07:00,405 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:00,405 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-23 15:07:00,405 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,46239,1690124809597' in zk 2023-07-23 15:07:00,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:00,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:00,407 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-23 15:07:00,407 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:00,407 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:07:00,408 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-23 15:07:00,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,34279,1690124809505': 2023-07-23 15:07:00,409 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34279,1690124809505' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-23 15:07:00,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:00,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:07:00,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:07:00,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:07:00,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:07:00,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:00,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:00,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:00,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:07:00,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:00,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:00,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:00,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,46239,1690124809597': 2023-07-23 15:07:00,414 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46239,1690124809597' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-23 15:07:00,414 INFO [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-23 15:07:00,414 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 15:07:00,414 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 15:07:00,414 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,414 INFO [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 15:07:00,419 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,419 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:07:00,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,420 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,420 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,420 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:07:00,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:07:00,419 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,420 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:07:00,420 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,420 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:07:00,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:07:00,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:07:00,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:07:00,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:07:00,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:07:00,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:07:00,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:07:00,421 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:00,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,422 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:00,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:07:00,423 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:00,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:00,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:00,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:00,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:07:00,425 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:00,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,426 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:00,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:00,427 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:00,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:00,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:00,442 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:07:00,442 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:07:00,442 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:07:00,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:07:00,442 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:07:00,442 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:07:00,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:07:00,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:07:00,442 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:07:00,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:07:00,443 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:07:00,443 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:07:00,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:07:00,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:07:00,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:07:00,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:07:00,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:07:00,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:07:00,446 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:00,446 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,446 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:00,446 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:00,446 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,446 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:00,446 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,446 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:07:00,446 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:00,446 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:00,447 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,447 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,447 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,448 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,451 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,470 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 15:07:00,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-23 15:07:00,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-23 15:07:00,472 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-23 15:07:00,511 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,577 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-23 15:07:00,577 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,578 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,578 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1690124820155Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1690124820448 (+293 ms)Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1690124820448Writing data manifest for emptySnaptb0-testExportWithTargetName at 1690124820463 (+15 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1690124820492 (+29 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1690124820577 (+85 ms) 2023-07-23 15:07:00,580 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-23 15:07:00,583 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 422 msec 2023-07-23 15:07:00,772 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 15:07:00,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-23 15:07:00,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 15:07:00,797 DEBUG [htable-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:07:00,802 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33332, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:07:00,803 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46239] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1690124818915.ae5bb88779130c4fe430937f66e867b9. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 15:07:00,803 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34279] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1690124818915.5e5d49986d647575b175db080ff1c99f. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 15:07:00,809 DEBUG [Listener at jenkins-hbase4.apache.org/33035] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-23 15:07:00,810 DEBUG [Listener at jenkins-hbase4.apache.org/33035] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1690124818915.ae5bb88779130c4fe430937f66e867b9. 2023-07-23 15:07:00,811 INFO [Listener at jenkins-hbase4.apache.org/33035] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 15:07:00,837 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-23 15:07:00,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690124820837 (current time:1690124820837). 2023-07-23 15:07:00,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 15:07:00,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] zookeeper.ReadOnlyZKClient(139): Connect 0x14017332 to 127.0.0.1:51019 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 15:07:00,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7e1e8177, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 15:07:00,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:07:00,847 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37970, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:07:00,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x14017332 to 127.0.0.1:51019 2023-07-23 15:07:00,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 15:07:00,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] zookeeper.ReadOnlyZKClient(139): Connect 0x1281eccf to 127.0.0.1:51019 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 15:07:00,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@d86954e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 15:07:00,858 DEBUG [hconnection-0x719a8b0-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:07:00,861 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37978, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:07:00,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1281eccf to 127.0.0.1:51019 2023-07-23 15:07:00,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 15:07:00,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-23 15:07:00,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 15:07:00,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-23 15:07:00,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-23 15:07:00,870 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-23 15:07:00,872 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1690125420872 2023-07-23 15:07:00,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-23 15:07:00,872 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-23 15:07:00,873 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 15:07:00,873 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 15:07:00,874 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-23 15:07:00,874 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-23 15:07:00,876 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 6 msec 2023-07-23 15:07:00,877 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-23 15:07:00,878 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1690125420878 2023-07-23 15:07:00,892 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-23 15:07:00,892 INFO [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-23 15:07:00,892 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:07:00,893 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-23 15:07:00,893 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-23 15:07:00,893 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 15:07:00,894 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-23 15:07:00,895 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:07:00,895 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:07:00,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:07:00,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:07:00,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:07:00,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:07:00,895 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:07:00,895 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:00,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:07:00,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:07:00,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-23 15:07:00,896 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:00,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-23 15:07:00,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-23 15:07:00,896 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:00,896 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 15:07:00,896 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 15:07:00,896 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:00,896 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 15:07:00,896 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 15:07:00,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-23 15:07:00,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-23 15:07:00,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-23 15:07:00,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-23 15:07:00,897 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-23 15:07:00,897 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-23 15:07:00,897 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-23 15:07:00,897 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-23 15:07:00,897 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-23 15:07:00,897 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-23 15:07:00,897 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:07:00,897 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:07:00,898 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-23 15:07:00,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-23 15:07:00,898 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-23 15:07:00,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-23 15:07:00,898 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-23 15:07:00,899 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-23 15:07:00,899 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-23 15:07:00,898 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46191,1690124809654' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-23 15:07:00,899 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46239,1690124809597' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-23 15:07:00,899 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-23 15:07:00,899 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-23 15:07:00,899 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:07:00,900 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-23 15:07:00,900 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-23 15:07:00,900 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34279,1690124809505' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-23 15:07:00,902 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 15:07:00,902 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 15:07:00,902 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:00,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:00,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:07:00,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:07:00,902 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 15:07:00,902 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 15:07:00,903 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:07:00,902 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:07:00,903 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:00,903 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 15:07:00,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:07:00,904 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 15:07:00,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:07:00,904 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:07:00,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-23 15:07:00,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:00,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:00,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:00,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:07:00,906 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46239,1690124809597' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-23 15:07:00,906 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@16eaecc3[Count = 1] remaining members to acquire global barrier 2023-07-23 15:07:00,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:00,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:07:00,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:07:00,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:07:00,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:07:00,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-23 15:07:00,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:00,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:00,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:00,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:07:00,908 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34279,1690124809505' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-23 15:07:00,908 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@16eaecc3[Count = 0] remaining members to acquire global barrier 2023-07-23 15:07:00,908 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-23 15:07:00,908 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 15:07:00,921 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 15:07:00,921 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 15:07:00,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 15:07:00,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 15:07:00,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 15:07:00,921 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 15:07:00,921 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:00,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 15:07:00,921 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-23 15:07:00,922 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-23 15:07:00,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 15:07:00,922 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-23 15:07:00,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 15:07:00,922 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 15:07:00,922 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:00,922 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 15:07:00,922 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 15:07:00,922 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1690124818915.ae5bb88779130c4fe430937f66e867b9. 2023-07-23 15:07:00,922 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-23 15:07:00,922 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1690124818915.ae5bb88779130c4fe430937f66e867b9. started... 2023-07-23 15:07:00,922 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,46191,1690124809654' in zk 2023-07-23 15:07:00,922 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 15:07:00,922 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 15:07:00,922 DEBUG [rs(jenkins-hbase4.apache.org,34279,1690124809505)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1690124818915.5e5d49986d647575b175db080ff1c99f. 2023-07-23 15:07:00,922 INFO [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ae5bb88779130c4fe430937f66e867b9 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-07-23 15:07:00,922 DEBUG [rs(jenkins-hbase4.apache.org,34279,1690124809505)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1690124818915.5e5d49986d647575b175db080ff1c99f. started... 2023-07-23 15:07:00,923 INFO [rs(jenkins-hbase4.apache.org,34279,1690124809505)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 5e5d49986d647575b175db080ff1c99f 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-07-23 15:07:00,925 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-23 15:07:00,925 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:07:00,925 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-23 15:07:00,973 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 15:07:00,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-23 15:07:00,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-23 15:07:00,975 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 15:07:01,175 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 15:07:01,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-23 15:07:01,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-23 15:07:01,177 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-23 15:07:01,429 INFO [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=400 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportWithTargetName/ae5bb88779130c4fe430937f66e867b9/.tmp/cf/9eade66f02214ba39d312b821b8a4dc1 2023-07-23 15:07:01,429 INFO [rs(jenkins-hbase4.apache.org,34279,1690124809505)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.87 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportWithTargetName/5e5d49986d647575b175db080ff1c99f/.tmp/cf/c9f8bafd787f4dbdae2b220d100e5ccd 2023-07-23 15:07:01,477 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 15:07:01,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-23 15:07:01,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-23 15:07:01,479 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-23 15:07:01,493 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportWithTargetName/ae5bb88779130c4fe430937f66e867b9/.tmp/cf/9eade66f02214ba39d312b821b8a4dc1 as hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportWithTargetName/ae5bb88779130c4fe430937f66e867b9/cf/9eade66f02214ba39d312b821b8a4dc1 2023-07-23 15:07:01,493 DEBUG [rs(jenkins-hbase4.apache.org,34279,1690124809505)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportWithTargetName/5e5d49986d647575b175db080ff1c99f/.tmp/cf/c9f8bafd787f4dbdae2b220d100e5ccd as hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportWithTargetName/5e5d49986d647575b175db080ff1c99f/cf/c9f8bafd787f4dbdae2b220d100e5ccd 2023-07-23 15:07:01,506 INFO [rs(jenkins-hbase4.apache.org,34279,1690124809505)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportWithTargetName/5e5d49986d647575b175db080ff1c99f/cf/c9f8bafd787f4dbdae2b220d100e5ccd, entries=44, sequenceid=6, filesize=7.8 K 2023-07-23 15:07:01,507 INFO [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportWithTargetName/ae5bb88779130c4fe430937f66e867b9/cf/9eade66f02214ba39d312b821b8a4dc1, entries=6, sequenceid=6, filesize=5.2 K 2023-07-23 15:07:01,512 INFO [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for ae5bb88779130c4fe430937f66e867b9 in 590ms, sequenceid=6, compaction requested=false 2023-07-23 15:07:01,512 INFO [rs(jenkins-hbase4.apache.org,34279,1690124809505)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for 5e5d49986d647575b175db080ff1c99f in 589ms, sequenceid=6, compaction requested=false 2023-07-23 15:07:01,512 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-23 15:07:01,513 DEBUG [rs(jenkins-hbase4.apache.org,34279,1690124809505)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-23 15:07:01,515 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ae5bb88779130c4fe430937f66e867b9: 2023-07-23 15:07:01,515 DEBUG [rs(jenkins-hbase4.apache.org,34279,1690124809505)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5e5d49986d647575b175db080ff1c99f: 2023-07-23 15:07:01,515 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1690124818915.ae5bb88779130c4fe430937f66e867b9.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-23 15:07:01,516 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 15:07:01,516 DEBUG [rs(jenkins-hbase4.apache.org,34279,1690124809505)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1690124818915.5e5d49986d647575b175db080ff1c99f.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-23 15:07:01,516 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportWithTargetName/ae5bb88779130c4fe430937f66e867b9/cf/9eade66f02214ba39d312b821b8a4dc1] hfiles 2023-07-23 15:07:01,516 DEBUG [rs(jenkins-hbase4.apache.org,34279,1690124809505)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 15:07:01,516 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportWithTargetName/ae5bb88779130c4fe430937f66e867b9/cf/9eade66f02214ba39d312b821b8a4dc1 for snapshot=snaptb0-testExportWithTargetName 2023-07-23 15:07:01,516 DEBUG [rs(jenkins-hbase4.apache.org,34279,1690124809505)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportWithTargetName/5e5d49986d647575b175db080ff1c99f/cf/c9f8bafd787f4dbdae2b220d100e5ccd] hfiles 2023-07-23 15:07:01,516 DEBUG [rs(jenkins-hbase4.apache.org,34279,1690124809505)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportWithTargetName/5e5d49986d647575b175db080ff1c99f/cf/c9f8bafd787f4dbdae2b220d100e5ccd for snapshot=snaptb0-testExportWithTargetName 2023-07-23 15:07:01,588 DEBUG [rs(jenkins-hbase4.apache.org,34279,1690124809505)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1690124818915.5e5d49986d647575b175db080ff1c99f. completed. 2023-07-23 15:07:01,588 DEBUG [rs(jenkins-hbase4.apache.org,34279,1690124809505)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1690124818915.5e5d49986d647575b175db080ff1c99f. 2023-07-23 15:07:01,588 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 15:07:01,588 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 15:07:01,588 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:01,588 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-23 15:07:01,588 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,34279,1690124809505' in zk 2023-07-23 15:07:01,591 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:01,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:01,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:07:01,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:07:01,592 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-23 15:07:01,592 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:07:01,592 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-23 15:07:01,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:07:01,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:07:01,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-23 15:07:01,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:01,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:01,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:01,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:07:01,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-23 15:07:01,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:01,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:01,602 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1690124818915.ae5bb88779130c4fe430937f66e867b9. completed. 2023-07-23 15:07:01,602 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1690124818915.ae5bb88779130c4fe430937f66e867b9. 2023-07-23 15:07:01,602 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 15:07:01,602 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 15:07:01,602 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:01,602 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-23 15:07:01,602 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,46239,1690124809597' in zk 2023-07-23 15:07:01,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,34279,1690124809505': 2023-07-23 15:07:01,603 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34279,1690124809505' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-23 15:07:01,604 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-23 15:07:01,604 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:01,604 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:07:01,604 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-23 15:07:01,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:01,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:07:01,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:07:01,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:07:01,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:07:01,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-23 15:07:01,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:01,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:01,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:01,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:07:01,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-23 15:07:01,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:01,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:01,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:01,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,46239,1690124809597': 2023-07-23 15:07:01,615 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46239,1690124809597' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-23 15:07:01,615 INFO [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-23 15:07:01,615 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 15:07:01,615 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 15:07:01,615 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-23 15:07:01,615 INFO [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 15:07:01,617 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 15:07:01,617 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 15:07:01,617 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 15:07:01,617 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 15:07:01,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 15:07:01,617 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:07:01,617 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 15:07:01,617 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:07:01,617 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 15:07:01,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 15:07:01,618 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 15:07:01,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 15:07:01,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 15:07:01,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:07:01,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:07:01,618 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:07:01,618 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:07:01,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:07:01,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:07:01,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:07:01,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:07:01,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:07:01,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 15:07:01,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 15:07:01,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 15:07:01,626 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:01,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:07:01,627 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:01,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-23 15:07:01,628 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:01,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:07:01,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-23 15:07:01,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:01,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:01,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:01,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:07:01,630 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:01,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-23 15:07:01,630 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:01,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:01,631 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:01,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:01,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:01,643 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:01,643 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:07:01,643 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:07:01,643 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:07:01,643 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:07:01,643 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:07:01,643 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:07:01,643 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-23 15:07:01,644 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-23 15:07:01,644 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:07:01,644 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-23 15:07:01,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:07:01,644 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:07:01,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:07:01,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:07:01,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:07:01,645 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:07:01,644 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:01,645 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:01,645 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-23 15:07:01,645 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:01,645 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 15:07:01,645 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:01,645 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:01,645 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 15:07:01,645 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 15:07:01,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:07:01,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:07:01,646 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-23 15:07:01,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:07:01,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:07:01,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:07:01,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:07:01,686 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-23 15:07:01,741 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-23 15:07:01,741 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-23 15:07:01,741 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-23 15:07:01,741 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1690124820872Consolidate snapshot: snaptb0-testExportWithTargetName at 1690124821644 (+772 ms)Loading Region manifests for snaptb0-testExportWithTargetName at 1690124821645 (+1 ms)Writing data manifest for snaptb0-testExportWithTargetName at 1690124821657 (+12 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1690124821676 (+19 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1690124821741 (+65 ms) 2023-07-23 15:07:01,743 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-23 15:07:01,746 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 870 msec 2023-07-23 15:07:01,980 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 15:07:01,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-23 15:07:01,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 15:07:01,983 INFO [Listener at jenkins-hbase4.apache.org/33035] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/export-test/export-1690124821983 2023-07-23 15:07:01,983 INFO [Listener at jenkins-hbase4.apache.org/33035] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:45535, tgtDir=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/export-test/export-1690124821983, rawTgtDir=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/export-test/export-1690124821983, srcFsUri=hdfs://localhost:45535, srcDir=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40 2023-07-23 15:07:02,025 DEBUG [Listener at jenkins-hbase4.apache.org/33035] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45535, inputRoot=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40 2023-07-23 15:07:02,026 DEBUG [Listener at jenkins-hbase4.apache.org/33035] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-994651783_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/export-test/export-1690124821983, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/export-test/export-1690124821983/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-23 15:07:02,026 INFO [Listener at jenkins-hbase4.apache.org/33035] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45535, inputRoot=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40, snapshotDir=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-23 15:07:02,041 INFO [Listener at jenkins-hbase4.apache.org/33035] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/export-test/export-1690124821983/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-23 15:07:02,102 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:02,102 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:02,103 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:02,104 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:02,104 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:02,105 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:02,105 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:02,191 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/hadoop-2906278428700148703.jar 2023-07-23 15:07:02,192 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:02,193 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:02,193 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:02,193 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:02,194 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:02,194 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:02,195 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-23 15:07:02,195 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-23 15:07:02,196 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-23 15:07:02,196 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-23 15:07:02,196 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-23 15:07:02,197 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-23 15:07:02,197 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-23 15:07:02,198 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-23 15:07:02,198 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-23 15:07:02,199 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-23 15:07:02,202 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 15:07:02,202 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 15:07:02,203 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 15:07:02,203 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 15:07:02,203 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 15:07:02,204 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 15:07:02,204 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 15:07:03,472 WARN [Listener at jenkins-hbase4.apache.org/33035] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-23 15:07:03,479 INFO [Listener at jenkins-hbase4.apache.org/33035] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-23 15:07:03,487 DEBUG [Listener at jenkins-hbase4.apache.org/33035] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-23 15:07:03,987 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 15:07:03,989 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 15:07:04,617 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690124817489_0001_000001 (auth:SIMPLE) 2023-07-23 15:07:04,940 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-23 15:07:09,907 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690124817489_0001_000001 (auth:SIMPLE) 2023-07-23 15:07:12,180 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690124817489_0001_000001 (auth:SIMPLE) 2023-07-23 15:07:15,229 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690124817489_0001_000001 (auth:SIMPLE) 2023-07-23 15:07:16,387 INFO [Listener at jenkins-hbase4.apache.org/33035] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-23 15:07:16,390 INFO [Listener at jenkins-hbase4.apache.org/33035] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-23 15:07:16,398 INFO [Listener at jenkins-hbase4.apache.org/33035] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-23 15:07:16,399 INFO [Listener at jenkins-hbase4.apache.org/33035] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-23 15:07:16,400 INFO [Listener at jenkins-hbase4.apache.org/33035] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-23 15:07:16,400 DEBUG [Listener at jenkins-hbase4.apache.org/33035] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-979742745_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-23 15:07:16,400 DEBUG [Listener at jenkins-hbase4.apache.org/33035] snapshot.TestExportSnapshot(367): hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-23 15:07:16,401 DEBUG [Listener at jenkins-hbase4.apache.org/33035] snapshot.TestExportSnapshot(367): hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-23 15:07:16,401 DEBUG [Listener at jenkins-hbase4.apache.org/33035] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-979742745_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/export-test/export-1690124821983/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/export-test/export-1690124821983/.hbase-snapshot/testExportWithTargetName 2023-07-23 15:07:16,401 DEBUG [Listener at jenkins-hbase4.apache.org/33035] snapshot.TestExportSnapshot(367): hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/export-test/export-1690124821983/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-23 15:07:16,401 DEBUG [Listener at jenkins-hbase4.apache.org/33035] snapshot.TestExportSnapshot(367): hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/export-test/export-1690124821983/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-23 15:07:16,412 INFO [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-23 15:07:16,417 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-23 15:07:16,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-23 15:07:16,430 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690124836430"}]},"ts":"1690124836430"} 2023-07-23 15:07:16,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-23 15:07:16,432 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-23 15:07:16,434 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-23 15:07:16,435 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ae5bb88779130c4fe430937f66e867b9, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5e5d49986d647575b175db080ff1c99f, UNASSIGN}] 2023-07-23 15:07:16,437 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5e5d49986d647575b175db080ff1c99f, UNASSIGN 2023-07-23 15:07:16,438 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ae5bb88779130c4fe430937f66e867b9, UNASSIGN 2023-07-23 15:07:16,438 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=5e5d49986d647575b175db080ff1c99f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:16,439 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=ae5bb88779130c4fe430937f66e867b9, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:16,439 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1690124818915.ae5bb88779130c4fe430937f66e867b9.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690124836439"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690124836439"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690124836439"}]},"ts":"1690124836439"} 2023-07-23 15:07:16,439 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1690124818915.5e5d49986d647575b175db080ff1c99f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690124836438"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690124836438"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690124836438"}]},"ts":"1690124836438"} 2023-07-23 15:07:16,441 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure ae5bb88779130c4fe430937f66e867b9, server=jenkins-hbase4.apache.org,46239,1690124809597}] 2023-07-23 15:07:16,441 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure 5e5d49986d647575b175db080ff1c99f, server=jenkins-hbase4.apache.org,34279,1690124809505}] 2023-07-23 15:07:16,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-23 15:07:16,601 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5e5d49986d647575b175db080ff1c99f 2023-07-23 15:07:16,601 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ae5bb88779130c4fe430937f66e867b9 2023-07-23 15:07:16,601 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5e5d49986d647575b175db080ff1c99f, disabling compactions & flushes 2023-07-23 15:07:16,601 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ae5bb88779130c4fe430937f66e867b9, disabling compactions & flushes 2023-07-23 15:07:16,601 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1690124818915.5e5d49986d647575b175db080ff1c99f. 2023-07-23 15:07:16,601 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1690124818915.ae5bb88779130c4fe430937f66e867b9. 2023-07-23 15:07:16,601 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1690124818915.5e5d49986d647575b175db080ff1c99f. 2023-07-23 15:07:16,601 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1690124818915.ae5bb88779130c4fe430937f66e867b9. 2023-07-23 15:07:16,601 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1690124818915.5e5d49986d647575b175db080ff1c99f. after waiting 0 ms 2023-07-23 15:07:16,601 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1690124818915.ae5bb88779130c4fe430937f66e867b9. after waiting 0 ms 2023-07-23 15:07:16,601 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1690124818915.5e5d49986d647575b175db080ff1c99f. 2023-07-23 15:07:16,601 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1690124818915.ae5bb88779130c4fe430937f66e867b9. 2023-07-23 15:07:16,614 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportWithTargetName/ae5bb88779130c4fe430937f66e867b9/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 15:07:16,614 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportWithTargetName/5e5d49986d647575b175db080ff1c99f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 15:07:16,615 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 15:07:16,615 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 15:07:16,616 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1690124818915.ae5bb88779130c4fe430937f66e867b9. 2023-07-23 15:07:16,616 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1690124818915.5e5d49986d647575b175db080ff1c99f. 2023-07-23 15:07:16,616 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ae5bb88779130c4fe430937f66e867b9: 2023-07-23 15:07:16,616 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5e5d49986d647575b175db080ff1c99f: 2023-07-23 15:07:16,618 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5e5d49986d647575b175db080ff1c99f 2023-07-23 15:07:16,619 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=5e5d49986d647575b175db080ff1c99f, regionState=CLOSED 2023-07-23 15:07:16,619 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ae5bb88779130c4fe430937f66e867b9 2023-07-23 15:07:16,619 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1690124818915.5e5d49986d647575b175db080ff1c99f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690124836619"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690124836619"}]},"ts":"1690124836619"} 2023-07-23 15:07:16,620 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=ae5bb88779130c4fe430937f66e867b9, regionState=CLOSED 2023-07-23 15:07:16,620 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1690124818915.ae5bb88779130c4fe430937f66e867b9.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690124836620"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690124836620"}]},"ts":"1690124836620"} 2023-07-23 15:07:16,624 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=23 2023-07-23 15:07:16,624 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure 5e5d49986d647575b175db080ff1c99f, server=jenkins-hbase4.apache.org,34279,1690124809505 in 180 msec 2023-07-23 15:07:16,626 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=22 2023-07-23 15:07:16,626 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5e5d49986d647575b175db080ff1c99f, UNASSIGN in 189 msec 2023-07-23 15:07:16,626 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure ae5bb88779130c4fe430937f66e867b9, server=jenkins-hbase4.apache.org,46239,1690124809597 in 181 msec 2023-07-23 15:07:16,628 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=21 2023-07-23 15:07:16,628 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ae5bb88779130c4fe430937f66e867b9, UNASSIGN in 191 msec 2023-07-23 15:07:16,629 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690124836629"}]},"ts":"1690124836629"} 2023-07-23 15:07:16,630 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-23 15:07:16,632 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-23 15:07:16,635 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 213 msec 2023-07-23 15:07:16,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-23 15:07:16,734 INFO [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-23 15:07:16,739 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-23 15:07:16,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-23 15:07:16,749 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-23 15:07:16,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-23 15:07:16,751 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-23 15:07:16,754 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34279] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-23 15:07:16,757 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportWithTargetName/ae5bb88779130c4fe430937f66e867b9 2023-07-23 15:07:16,757 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportWithTargetName/5e5d49986d647575b175db080ff1c99f 2023-07-23 15:07:16,758 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-23 15:07:16,758 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-23 15:07:16,758 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-23 15:07:16,758 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-23 15:07:16,760 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:07:16,760 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:07:16,760 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-23 15:07:16,760 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-23 15:07:16,760 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-23 15:07:16,760 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:07:16,761 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:07:16,760 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-23 15:07:16,761 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-23 15:07:16,761 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-23 15:07:16,760 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-23 15:07:16,761 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-23 15:07:16,761 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportWithTargetName/5e5d49986d647575b175db080ff1c99f/cf, FileablePath, hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportWithTargetName/5e5d49986d647575b175db080ff1c99f/recovered.edits] 2023-07-23 15:07:16,761 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportWithTargetName/ae5bb88779130c4fe430937f66e867b9/cf, FileablePath, hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportWithTargetName/ae5bb88779130c4fe430937f66e867b9/recovered.edits] 2023-07-23 15:07:16,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-23 15:07:16,769 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportWithTargetName/5e5d49986d647575b175db080ff1c99f/cf/c9f8bafd787f4dbdae2b220d100e5ccd to hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/archive/data/default/testtb-testExportWithTargetName/5e5d49986d647575b175db080ff1c99f/cf/c9f8bafd787f4dbdae2b220d100e5ccd 2023-07-23 15:07:16,769 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportWithTargetName/ae5bb88779130c4fe430937f66e867b9/cf/9eade66f02214ba39d312b821b8a4dc1 to hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/archive/data/default/testtb-testExportWithTargetName/ae5bb88779130c4fe430937f66e867b9/cf/9eade66f02214ba39d312b821b8a4dc1 2023-07-23 15:07:16,773 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportWithTargetName/5e5d49986d647575b175db080ff1c99f/recovered.edits/9.seqid to hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/archive/data/default/testtb-testExportWithTargetName/5e5d49986d647575b175db080ff1c99f/recovered.edits/9.seqid 2023-07-23 15:07:16,773 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportWithTargetName/ae5bb88779130c4fe430937f66e867b9/recovered.edits/9.seqid to hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/archive/data/default/testtb-testExportWithTargetName/ae5bb88779130c4fe430937f66e867b9/recovered.edits/9.seqid 2023-07-23 15:07:16,774 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportWithTargetName/5e5d49986d647575b175db080ff1c99f 2023-07-23 15:07:16,774 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportWithTargetName/ae5bb88779130c4fe430937f66e867b9 2023-07-23 15:07:16,774 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-23 15:07:16,777 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-23 15:07:16,797 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-23 15:07:16,799 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-23 15:07:16,801 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-23 15:07:16,801 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-23 15:07:16,801 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1690124818915.ae5bb88779130c4fe430937f66e867b9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690124836801"}]},"ts":"9223372036854775807"} 2023-07-23 15:07:16,801 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1690124818915.5e5d49986d647575b175db080ff1c99f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690124836801"}]},"ts":"9223372036854775807"} 2023-07-23 15:07:16,804 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-23 15:07:16,804 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => ae5bb88779130c4fe430937f66e867b9, NAME => 'testtb-testExportWithTargetName,,1690124818915.ae5bb88779130c4fe430937f66e867b9.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 5e5d49986d647575b175db080ff1c99f, NAME => 'testtb-testExportWithTargetName,1,1690124818915.5e5d49986d647575b175db080ff1c99f.', STARTKEY => '1', ENDKEY => ''}] 2023-07-23 15:07:16,804 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-23 15:07:16,804 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690124836804"}]},"ts":"9223372036854775807"} 2023-07-23 15:07:16,806 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-23 15:07:16,808 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-23 15:07:16,810 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 67 msec 2023-07-23 15:07:16,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-23 15:07:16,865 INFO [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-23 15:07:16,883 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-23 15:07:16,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:16,888 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-23 15:07:16,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-23 15:07:16,921 INFO [Listener at jenkins-hbase4.apache.org/33035] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=755 (was 708) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/cluster_1af599d2-744d-4b83-6c9a-48c564e4b3e8/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (449583813) connection to jenkins-hbase4.apache.org/172.31.14.131:43203 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/cluster_1af599d2-744d-4b83-6c9a-48c564e4b3e8/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3d9205bb-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1282 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-979742745_17 at /127.0.0.1:59166 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/cluster_1af599d2-744d-4b83-6c9a-48c564e4b3e8/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3d9205bb-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-979742745_17 at /127.0.0.1:38478 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1940585832_1 at /127.0.0.1:38448 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/cluster_1af599d2-744d-4b83-6c9a-48c564e4b3e8/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3d9205bb-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/cluster_1af599d2-744d-4b83-6c9a-48c564e4b3e8/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (449583813) connection to jenkins-hbase4.apache.org/172.31.14.131:44791 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-979742745_17 at /127.0.0.1:35028 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1940585832_1 at /127.0.0.1:59154 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3d9205bb-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/cluster_1af599d2-744d-4b83-6c9a-48c564e4b3e8/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=916 (was 898) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=199 (was 111) - SystemLoadAverage LEAK? -, ProcessCount=179 (was 173) - ProcessCount LEAK? -, AvailableMemoryMB=6569 (was 8332) 2023-07-23 15:07:16,921 WARN [Listener at jenkins-hbase4.apache.org/33035] hbase.ResourceChecker(130): Thread=755 is superior to 500 2023-07-23 15:07:16,941 INFO [Listener at jenkins-hbase4.apache.org/33035] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=755, OpenFileDescriptor=916, MaxFileDescriptor=60000, SystemLoadAverage=199, ProcessCount=179, AvailableMemoryMB=6569 2023-07-23 15:07:16,941 WARN [Listener at jenkins-hbase4.apache.org/33035] hbase.ResourceChecker(130): Thread=755 is superior to 500 2023-07-23 15:07:16,943 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-23 15:07:16,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-23 15:07:16,948 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-23 15:07:16,948 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-23 15:07:16,949 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-23 15:07:16,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-23 15:07:16,952 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemState/37431119a48c0015daed4bf9da306560 2023-07-23 15:07:16,952 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemState/ddd70301dc9d0734f50cc6b3d6ee482e 2023-07-23 15:07:16,952 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemState/37431119a48c0015daed4bf9da306560 empty. 2023-07-23 15:07:16,953 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemState/ddd70301dc9d0734f50cc6b3d6ee482e empty. 2023-07-23 15:07:16,953 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemState/37431119a48c0015daed4bf9da306560 2023-07-23 15:07:16,953 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemState/ddd70301dc9d0734f50cc6b3d6ee482e 2023-07-23 15:07:16,953 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-23 15:07:16,970 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-23 15:07:16,972 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 37431119a48c0015daed4bf9da306560, NAME => 'testtb-testExportFileSystemState,,1690124836943.37431119a48c0015daed4bf9da306560.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp 2023-07-23 15:07:16,972 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => ddd70301dc9d0734f50cc6b3d6ee482e, NAME => 'testtb-testExportFileSystemState,1,1690124836943.ddd70301dc9d0734f50cc6b3d6ee482e.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp 2023-07-23 15:07:16,996 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1690124836943.ddd70301dc9d0734f50cc6b3d6ee482e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:07:16,996 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing ddd70301dc9d0734f50cc6b3d6ee482e, disabling compactions & flushes 2023-07-23 15:07:16,996 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1690124836943.ddd70301dc9d0734f50cc6b3d6ee482e. 2023-07-23 15:07:16,996 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1690124836943.ddd70301dc9d0734f50cc6b3d6ee482e. 2023-07-23 15:07:16,997 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1690124836943.ddd70301dc9d0734f50cc6b3d6ee482e. after waiting 0 ms 2023-07-23 15:07:16,997 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1690124836943.ddd70301dc9d0734f50cc6b3d6ee482e. 2023-07-23 15:07:16,997 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1690124836943.ddd70301dc9d0734f50cc6b3d6ee482e. 2023-07-23 15:07:16,997 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for ddd70301dc9d0734f50cc6b3d6ee482e: 2023-07-23 15:07:16,999 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1690124836943.37431119a48c0015daed4bf9da306560.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:07:17,000 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 37431119a48c0015daed4bf9da306560, disabling compactions & flushes 2023-07-23 15:07:17,000 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1690124836943.37431119a48c0015daed4bf9da306560. 2023-07-23 15:07:17,000 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1690124836943.37431119a48c0015daed4bf9da306560. 2023-07-23 15:07:17,000 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1690124836943.37431119a48c0015daed4bf9da306560. after waiting 0 ms 2023-07-23 15:07:17,000 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1690124836943.37431119a48c0015daed4bf9da306560. 2023-07-23 15:07:17,000 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1690124836943.37431119a48c0015daed4bf9da306560. 2023-07-23 15:07:17,000 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 37431119a48c0015daed4bf9da306560: 2023-07-23 15:07:17,003 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-23 15:07:17,004 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1690124836943.ddd70301dc9d0734f50cc6b3d6ee482e.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690124837003"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690124837003"}]},"ts":"1690124837003"} 2023-07-23 15:07:17,004 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1690124836943.37431119a48c0015daed4bf9da306560.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690124837003"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690124837003"}]},"ts":"1690124837003"} 2023-07-23 15:07:17,006 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-23 15:07:17,007 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-23 15:07:17,008 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690124837007"}]},"ts":"1690124837007"} 2023-07-23 15:07:17,009 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-23 15:07:17,013 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-23 15:07:17,014 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-23 15:07:17,014 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-23 15:07:17,014 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-23 15:07:17,015 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-23 15:07:17,015 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=37431119a48c0015daed4bf9da306560, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ddd70301dc9d0734f50cc6b3d6ee482e, ASSIGN}] 2023-07-23 15:07:17,017 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=37431119a48c0015daed4bf9da306560, ASSIGN 2023-07-23 15:07:17,017 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ddd70301dc9d0734f50cc6b3d6ee482e, ASSIGN 2023-07-23 15:07:17,018 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=37431119a48c0015daed4bf9da306560, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34279,1690124809505; forceNewPlan=false, retain=false 2023-07-23 15:07:17,018 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ddd70301dc9d0734f50cc6b3d6ee482e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46239,1690124809597; forceNewPlan=false, retain=false 2023-07-23 15:07:17,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-23 15:07:17,168 INFO [jenkins-hbase4:38379] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-23 15:07:17,171 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=ddd70301dc9d0734f50cc6b3d6ee482e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:17,171 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=37431119a48c0015daed4bf9da306560, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:17,172 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1690124836943.ddd70301dc9d0734f50cc6b3d6ee482e.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690124837171"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690124837171"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690124837171"}]},"ts":"1690124837171"} 2023-07-23 15:07:17,173 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1690124836943.37431119a48c0015daed4bf9da306560.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690124837171"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690124837171"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690124837171"}]},"ts":"1690124837171"} 2023-07-23 15:07:17,176 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure ddd70301dc9d0734f50cc6b3d6ee482e, server=jenkins-hbase4.apache.org,46239,1690124809597}] 2023-07-23 15:07:17,178 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 37431119a48c0015daed4bf9da306560, server=jenkins-hbase4.apache.org,34279,1690124809505}] 2023-07-23 15:07:17,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-23 15:07:17,332 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1690124836943.ddd70301dc9d0734f50cc6b3d6ee482e. 2023-07-23 15:07:17,332 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ddd70301dc9d0734f50cc6b3d6ee482e, NAME => 'testtb-testExportFileSystemState,1,1690124836943.ddd70301dc9d0734f50cc6b3d6ee482e.', STARTKEY => '1', ENDKEY => ''} 2023-07-23 15:07:17,332 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1690124836943.ddd70301dc9d0734f50cc6b3d6ee482e. service=AccessControlService 2023-07-23 15:07:17,332 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 15:07:17,333 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState ddd70301dc9d0734f50cc6b3d6ee482e 2023-07-23 15:07:17,333 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1690124836943.ddd70301dc9d0734f50cc6b3d6ee482e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:07:17,333 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ddd70301dc9d0734f50cc6b3d6ee482e 2023-07-23 15:07:17,333 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ddd70301dc9d0734f50cc6b3d6ee482e 2023-07-23 15:07:17,333 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1690124836943.37431119a48c0015daed4bf9da306560. 2023-07-23 15:07:17,333 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 37431119a48c0015daed4bf9da306560, NAME => 'testtb-testExportFileSystemState,,1690124836943.37431119a48c0015daed4bf9da306560.', STARTKEY => '', ENDKEY => '1'} 2023-07-23 15:07:17,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1690124836943.37431119a48c0015daed4bf9da306560. service=AccessControlService 2023-07-23 15:07:17,334 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 15:07:17,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 37431119a48c0015daed4bf9da306560 2023-07-23 15:07:17,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1690124836943.37431119a48c0015daed4bf9da306560.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:07:17,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 37431119a48c0015daed4bf9da306560 2023-07-23 15:07:17,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 37431119a48c0015daed4bf9da306560 2023-07-23 15:07:17,334 INFO [StoreOpener-ddd70301dc9d0734f50cc6b3d6ee482e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ddd70301dc9d0734f50cc6b3d6ee482e 2023-07-23 15:07:17,336 INFO [StoreOpener-37431119a48c0015daed4bf9da306560-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 37431119a48c0015daed4bf9da306560 2023-07-23 15:07:17,336 DEBUG [StoreOpener-ddd70301dc9d0734f50cc6b3d6ee482e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemState/ddd70301dc9d0734f50cc6b3d6ee482e/cf 2023-07-23 15:07:17,336 DEBUG [StoreOpener-ddd70301dc9d0734f50cc6b3d6ee482e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemState/ddd70301dc9d0734f50cc6b3d6ee482e/cf 2023-07-23 15:07:17,337 INFO [StoreOpener-ddd70301dc9d0734f50cc6b3d6ee482e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ddd70301dc9d0734f50cc6b3d6ee482e columnFamilyName cf 2023-07-23 15:07:17,337 DEBUG [StoreOpener-37431119a48c0015daed4bf9da306560-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemState/37431119a48c0015daed4bf9da306560/cf 2023-07-23 15:07:17,337 DEBUG [StoreOpener-37431119a48c0015daed4bf9da306560-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemState/37431119a48c0015daed4bf9da306560/cf 2023-07-23 15:07:17,337 INFO [StoreOpener-ddd70301dc9d0734f50cc6b3d6ee482e-1] regionserver.HStore(310): Store=ddd70301dc9d0734f50cc6b3d6ee482e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 15:07:17,339 INFO [StoreOpener-37431119a48c0015daed4bf9da306560-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 37431119a48c0015daed4bf9da306560 columnFamilyName cf 2023-07-23 15:07:17,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemState/ddd70301dc9d0734f50cc6b3d6ee482e 2023-07-23 15:07:17,340 INFO [StoreOpener-37431119a48c0015daed4bf9da306560-1] regionserver.HStore(310): Store=37431119a48c0015daed4bf9da306560/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 15:07:17,341 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemState/ddd70301dc9d0734f50cc6b3d6ee482e 2023-07-23 15:07:17,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemState/37431119a48c0015daed4bf9da306560 2023-07-23 15:07:17,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemState/37431119a48c0015daed4bf9da306560 2023-07-23 15:07:17,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ddd70301dc9d0734f50cc6b3d6ee482e 2023-07-23 15:07:17,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 37431119a48c0015daed4bf9da306560 2023-07-23 15:07:17,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemState/ddd70301dc9d0734f50cc6b3d6ee482e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 15:07:17,348 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemState/37431119a48c0015daed4bf9da306560/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 15:07:17,348 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ddd70301dc9d0734f50cc6b3d6ee482e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69041478, jitterRate=0.028798192739486694}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 15:07:17,348 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ddd70301dc9d0734f50cc6b3d6ee482e: 2023-07-23 15:07:17,348 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 37431119a48c0015daed4bf9da306560; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64137872, jitterRate=-0.044271230697631836}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 15:07:17,348 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 37431119a48c0015daed4bf9da306560: 2023-07-23 15:07:17,349 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1690124836943.ddd70301dc9d0734f50cc6b3d6ee482e., pid=30, masterSystemTime=1690124837328 2023-07-23 15:07:17,349 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1690124836943.37431119a48c0015daed4bf9da306560., pid=31, masterSystemTime=1690124837330 2023-07-23 15:07:17,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1690124836943.ddd70301dc9d0734f50cc6b3d6ee482e. 2023-07-23 15:07:17,351 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1690124836943.ddd70301dc9d0734f50cc6b3d6ee482e. 2023-07-23 15:07:17,352 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=ddd70301dc9d0734f50cc6b3d6ee482e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:17,352 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1690124836943.ddd70301dc9d0734f50cc6b3d6ee482e.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690124837352"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690124837352"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690124837352"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690124837352"}]},"ts":"1690124837352"} 2023-07-23 15:07:17,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1690124836943.37431119a48c0015daed4bf9da306560. 2023-07-23 15:07:17,353 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1690124836943.37431119a48c0015daed4bf9da306560. 2023-07-23 15:07:17,353 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=37431119a48c0015daed4bf9da306560, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:17,354 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1690124836943.37431119a48c0015daed4bf9da306560.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690124837353"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690124837353"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690124837353"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690124837353"}]},"ts":"1690124837353"} 2023-07-23 15:07:17,358 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=29 2023-07-23 15:07:17,359 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure ddd70301dc9d0734f50cc6b3d6ee482e, server=jenkins-hbase4.apache.org,46239,1690124809597 in 179 msec 2023-07-23 15:07:17,360 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=28 2023-07-23 15:07:17,361 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 37431119a48c0015daed4bf9da306560, server=jenkins-hbase4.apache.org,34279,1690124809505 in 178 msec 2023-07-23 15:07:17,361 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ddd70301dc9d0734f50cc6b3d6ee482e, ASSIGN in 343 msec 2023-07-23 15:07:17,363 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-07-23 15:07:17,363 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=37431119a48c0015daed4bf9da306560, ASSIGN in 346 msec 2023-07-23 15:07:17,364 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-23 15:07:17,365 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690124837364"}]},"ts":"1690124837364"} 2023-07-23 15:07:17,366 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-23 15:07:17,369 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-23 15:07:17,370 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-23 15:07:17,372 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34279] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-23 15:07:17,373 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:07:17,373 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:07:17,373 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:07:17,373 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:07:17,376 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-23 15:07:17,376 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-23 15:07:17,376 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-23 15:07:17,377 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-23 15:07:17,378 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 432 msec 2023-07-23 15:07:17,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-23 15:07:17,553 INFO [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-23 15:07:17,553 DEBUG [Listener at jenkins-hbase4.apache.org/33035] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemState get assigned. Timeout = 60000ms 2023-07-23 15:07:17,554 INFO [Listener at jenkins-hbase4.apache.org/33035] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 15:07:17,557 INFO [Listener at jenkins-hbase4.apache.org/33035] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemState assigned to meta. Checking AM states. 2023-07-23 15:07:17,557 INFO [Listener at jenkins-hbase4.apache.org/33035] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 15:07:17,557 INFO [Listener at jenkins-hbase4.apache.org/33035] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemState assigned. 2023-07-23 15:07:17,562 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 15:07:17,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690124837562 (current time:1690124837562). 2023-07-23 15:07:17,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 15:07:17,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] zookeeper.ReadOnlyZKClient(139): Connect 0x3cd6a793 to 127.0.0.1:51019 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 15:07:17,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4b2168ff, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 15:07:17,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:07:17,573 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40582, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:07:17,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3cd6a793 to 127.0.0.1:51019 2023-07-23 15:07:17,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 15:07:17,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] zookeeper.ReadOnlyZKClient(139): Connect 0x69578966 to 127.0.0.1:51019 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 15:07:17,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@603451e0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 15:07:17,584 DEBUG [hconnection-0x2012bb89-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:07:17,585 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40598, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:07:17,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x69578966 to 127.0.0.1:51019 2023-07-23 15:07:17,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 15:07:17,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-23 15:07:17,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 15:07:17,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 15:07:17,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-23 15:07:17,596 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-23 15:07:17,597 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690125437597 2023-07-23 15:07:17,597 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-23 15:07:17,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 15:07:17,599 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 15:07:17,599 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 15:07:17,599 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-23 15:07:17,600 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-23 15:07:17,602 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-23 15:07:17,603 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-23 15:07:17,604 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690125437604 2023-07-23 15:07:17,621 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:17,621 INFO [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-23 15:07:17,621 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:07:17,622 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-23 15:07:17,622 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-23 15:07:17,623 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:17,623 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:17,624 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:07:17,624 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:07:17,624 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:17,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:07:17,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:07:17,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:07:17,624 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:07:17,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:07:17,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:07:17,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:07:17,625 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:17,625 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:17,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:17,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:17,625 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:17,626 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 15:07:17,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:17,626 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:17,626 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:17,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-23 15:07:17,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:17,627 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:17,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-23 15:07:17,627 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-23 15:07:17,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:17,627 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-23 15:07:17,627 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:17,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-23 15:07:17,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:17,627 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:17,627 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-23 15:07:17,627 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-23 15:07:17,628 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:07:17,627 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-23 15:07:17,628 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:07:17,630 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:17,631 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-23 15:07:17,632 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-23 15:07:17,631 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-23 15:07:17,632 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-23 15:07:17,632 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:07:17,632 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-23 15:07:17,633 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-23 15:07:17,633 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-23 15:07:17,632 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34279,1690124809505' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-23 15:07:17,633 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46191,1690124809654' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-23 15:07:17,633 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46239,1690124809597' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-23 15:07:17,639 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:17,639 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:17,639 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:17,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:17,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:07:17,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:07:17,639 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:17,639 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:17,640 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:17,640 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:07:17,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:07:17,639 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:17,640 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:07:17,640 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:17,640 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:07:17,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:07:17,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:17,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:17,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:17,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:17,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:07:17,642 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46239,1690124809597' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-23 15:07:17,642 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4fd67160[Count = 1] remaining members to acquire global barrier 2023-07-23 15:07:17,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:17,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:07:17,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:07:17,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:07:17,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:07:17,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:17,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:17,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:17,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:17,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:07:17,645 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34279,1690124809505' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-23 15:07:17,645 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4fd67160[Count = 0] remaining members to acquire global barrier 2023-07-23 15:07:17,645 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-23 15:07:17,645 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:17,646 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:17,646 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:17,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:17,646 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:17,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:17,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:17,646 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-23 15:07:17,646 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:17,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:17,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:17,647 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-23 15:07:17,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:17,647 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1690124836943.ddd70301dc9d0734f50cc6b3d6ee482e. 2023-07-23 15:07:17,647 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 15:07:17,647 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:17,647 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 15:07:17,647 DEBUG [rs(jenkins-hbase4.apache.org,34279,1690124809505)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1690124836943.37431119a48c0015daed4bf9da306560. 2023-07-23 15:07:17,647 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 15:07:17,647 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 15:07:17,647 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1690124836943.ddd70301dc9d0734f50cc6b3d6ee482e. started... 2023-07-23 15:07:17,647 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-23 15:07:17,647 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 15:07:17,647 DEBUG [rs(jenkins-hbase4.apache.org,34279,1690124809505)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1690124836943.37431119a48c0015daed4bf9da306560. started... 2023-07-23 15:07:17,647 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-23 15:07:17,649 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ddd70301dc9d0734f50cc6b3d6ee482e: 2023-07-23 15:07:17,650 DEBUG [rs(jenkins-hbase4.apache.org,34279,1690124809505)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 37431119a48c0015daed4bf9da306560: 2023-07-23 15:07:17,649 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46191,1690124809654' in zk 2023-07-23 15:07:17,650 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1690124836943.ddd70301dc9d0734f50cc6b3d6ee482e.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:17,650 DEBUG [rs(jenkins-hbase4.apache.org,34279,1690124809505)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1690124836943.37431119a48c0015daed4bf9da306560.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:17,650 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 15:07:17,650 DEBUG [rs(jenkins-hbase4.apache.org,34279,1690124809505)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 15:07:17,650 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 15:07:17,651 DEBUG [rs(jenkins-hbase4.apache.org,34279,1690124809505)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 15:07:17,652 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-23 15:07:17,652 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:07:17,652 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-23 15:07:17,676 DEBUG [rs(jenkins-hbase4.apache.org,34279,1690124809505)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1690124836943.37431119a48c0015daed4bf9da306560. completed. 2023-07-23 15:07:17,676 DEBUG [rs(jenkins-hbase4.apache.org,34279,1690124809505)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1690124836943.37431119a48c0015daed4bf9da306560. 2023-07-23 15:07:17,676 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 15:07:17,676 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 15:07:17,676 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:17,676 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-23 15:07:17,677 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34279,1690124809505' in zk 2023-07-23 15:07:17,680 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-23 15:07:17,680 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:07:17,680 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-23 15:07:17,681 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:17,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:17,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:07:17,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:07:17,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:07:17,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:07:17,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:17,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:17,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:17,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:17,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:07:17,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:17,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:17,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:17,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,34279,1690124809505': 2023-07-23 15:07:17,688 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34279,1690124809505' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-23 15:07:17,688 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1690124836943.ddd70301dc9d0734f50cc6b3d6ee482e. completed. 2023-07-23 15:07:17,688 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1690124836943.ddd70301dc9d0734f50cc6b3d6ee482e. 2023-07-23 15:07:17,688 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 15:07:17,688 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 15:07:17,688 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:17,689 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-23 15:07:17,689 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46239,1690124809597' in zk 2023-07-23 15:07:17,690 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:17,690 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-23 15:07:17,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:17,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:07:17,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:07:17,690 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:07:17,691 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-23 15:07:17,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:07:17,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:07:17,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:17,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:17,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:17,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:17,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:07:17,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:17,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:17,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:17,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:17,699 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 15:07:17,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,46239,1690124809597': 2023-07-23 15:07:17,700 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46239,1690124809597' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-23 15:07:17,700 INFO [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-23 15:07:17,700 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 15:07:17,700 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 15:07:17,700 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:17,700 INFO [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 15:07:17,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 15:07:17,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-23 15:07:17,704 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 15:07:17,704 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:17,704 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:07:17,704 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:17,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:17,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:17,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:17,704 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:07:17,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:17,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:07:17,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:07:17,705 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:17,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:07:17,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:07:17,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:17,706 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:17,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:17,706 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:17,706 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:07:17,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:17,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:17,707 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:17,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:07:17,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:07:17,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:17,709 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:17,709 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:17,710 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:17,710 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:17,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:17,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:07:17,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:07:17,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:07:17,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:17,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:07:17,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:17,715 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:07:17,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:07:17,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:07:17,715 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:07:17,715 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:07:17,715 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:07:17,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:07:17,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:07:17,716 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:17,716 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:07:17,716 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:07:17,716 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:07:17,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:07:17,716 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:17,716 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:17,716 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:17,716 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:17,716 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:17,716 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:17,716 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:17,716 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:07:17,716 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:07:17,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:07:17,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:07:17,716 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:17,716 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:17,717 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:17,716 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:07:17,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:07:17,717 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:07:17,717 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:17,717 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:17,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:07:17,719 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:17,727 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState because node does not exist (not an error) 2023-07-23 15:07:17,781 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:17,904 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 15:07:17,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 15:07:17,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-23 15:07:17,905 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-23 15:07:18,205 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 15:07:18,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 15:07:18,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-23 15:07:18,207 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-23 15:07:18,210 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-23 15:07:18,210 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:18,211 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:18,211 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1690124837597Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1690124837717 (+120 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1690124837717Writing data manifest for emptySnaptb0-testExportFileSystemState at 1690124837741 (+24 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1690124837771 (+30 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1690124838210 (+439 ms) 2023-07-23 15:07:18,213 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-23 15:07:18,215 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 615 msec 2023-07-23 15:07:18,707 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 15:07:18,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 15:07:18,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 15:07:18,735 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34279] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1690124836943.37431119a48c0015daed4bf9da306560. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 15:07:18,738 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46239] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1690124836943.ddd70301dc9d0734f50cc6b3d6ee482e. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 15:07:18,745 DEBUG [Listener at jenkins-hbase4.apache.org/33035] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-23 15:07:18,745 DEBUG [Listener at jenkins-hbase4.apache.org/33035] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1690124836943.37431119a48c0015daed4bf9da306560. 2023-07-23 15:07:18,747 INFO [Listener at jenkins-hbase4.apache.org/33035] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 15:07:18,769 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 15:07:18,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690124838769 (current time:1690124838769). 2023-07-23 15:07:18,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 15:07:18,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] zookeeper.ReadOnlyZKClient(139): Connect 0x6b8ec990 to 127.0.0.1:51019 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 15:07:18,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@f786430, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 15:07:18,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:07:18,783 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40604, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:07:18,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6b8ec990 to 127.0.0.1:51019 2023-07-23 15:07:18,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 15:07:18,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] zookeeper.ReadOnlyZKClient(139): Connect 0x02c5b271 to 127.0.0.1:51019 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 15:07:18,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@538f97d7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 15:07:18,796 DEBUG [hconnection-0x6378dd5c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:07:18,799 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40612, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:07:18,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x02c5b271 to 127.0.0.1:51019 2023-07-23 15:07:18,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 15:07:18,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-23 15:07:18,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 15:07:18,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 15:07:18,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-23 15:07:18,809 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-23 15:07:18,810 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690125438810 2023-07-23 15:07:18,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 15:07:18,810 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-23 15:07:18,811 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 15:07:18,811 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 15:07:18,812 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-23 15:07:18,813 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-23 15:07:18,814 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-23 15:07:18,815 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-23 15:07:18,816 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690125438816 2023-07-23 15:07:18,838 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-23 15:07:18,838 INFO [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-23 15:07:18,838 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:07:18,840 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-23 15:07:18,840 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-23 15:07:18,840 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 15:07:18,840 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-23 15:07:18,844 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:07:18,845 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:07:18,845 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:07:18,845 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:07:18,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:07:18,844 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:07:18,844 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:18,845 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:07:18,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:07:18,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:07:18,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-23 15:07:18,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-23 15:07:18,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-23 15:07:18,846 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:18,846 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 15:07:18,846 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:18,846 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 15:07:18,846 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 15:07:18,846 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:18,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-23 15:07:18,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-23 15:07:18,846 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 15:07:18,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-23 15:07:18,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-23 15:07:18,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-23 15:07:18,847 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-23 15:07:18,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-23 15:07:18,847 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-23 15:07:18,847 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-23 15:07:18,847 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-23 15:07:18,847 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-23 15:07:18,847 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-23 15:07:18,847 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-23 15:07:18,847 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-23 15:07:18,847 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-23 15:07:18,847 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:07:18,847 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:07:18,849 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-23 15:07:18,851 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-23 15:07:18,851 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-23 15:07:18,847 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:07:18,851 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46239,1690124809597' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-23 15:07:18,852 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-23 15:07:18,852 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-23 15:07:18,852 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34279,1690124809505' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-23 15:07:18,851 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-23 15:07:18,852 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46191,1690124809654' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-23 15:07:18,854 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:18,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:18,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:07:18,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:07:18,855 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 15:07:18,855 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 15:07:18,855 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 15:07:18,856 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 15:07:18,856 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 15:07:18,856 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:07:18,856 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:07:18,863 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:18,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:07:18,863 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 15:07:18,863 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:07:18,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:07:18,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-23 15:07:18,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:18,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:18,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:18,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:07:18,867 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46239,1690124809597' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-23 15:07:18,867 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@e9b10ad[Count = 1] remaining members to acquire global barrier 2023-07-23 15:07:18,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:18,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:07:18,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:07:18,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:07:18,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:07:18,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-23 15:07:18,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:18,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:18,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:18,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:07:18,871 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34279,1690124809505' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-23 15:07:18,871 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@e9b10ad[Count = 0] remaining members to acquire global barrier 2023-07-23 15:07:18,871 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-23 15:07:18,871 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 15:07:18,873 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 15:07:18,873 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 15:07:18,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 15:07:18,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 15:07:18,873 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-23 15:07:18,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 15:07:18,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 15:07:18,873 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 15:07:18,873 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-23 15:07:18,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 15:07:18,873 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-23 15:07:18,874 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46191,1690124809654' in zk 2023-07-23 15:07:18,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 15:07:18,874 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-23 15:07:18,874 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:18,874 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:18,874 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 15:07:18,874 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 15:07:18,874 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 15:07:18,875 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1690124836943.ddd70301dc9d0734f50cc6b3d6ee482e. 2023-07-23 15:07:18,875 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1690124836943.ddd70301dc9d0734f50cc6b3d6ee482e. started... 2023-07-23 15:07:18,875 INFO [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ddd70301dc9d0734f50cc6b3d6ee482e 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-23 15:07:18,876 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-23 15:07:18,876 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:07:18,876 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-23 15:07:18,878 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 15:07:18,880 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 15:07:18,880 DEBUG [rs(jenkins-hbase4.apache.org,34279,1690124809505)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1690124836943.37431119a48c0015daed4bf9da306560. 2023-07-23 15:07:18,880 DEBUG [rs(jenkins-hbase4.apache.org,34279,1690124809505)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1690124836943.37431119a48c0015daed4bf9da306560. started... 2023-07-23 15:07:18,881 INFO [rs(jenkins-hbase4.apache.org,34279,1690124809505)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 37431119a48c0015daed4bf9da306560 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-23 15:07:18,907 INFO [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemState/ddd70301dc9d0734f50cc6b3d6ee482e/.tmp/cf/5321420e96a0460db300919cbaf9e9d2 2023-07-23 15:07:18,911 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 15:07:18,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 15:07:18,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-23 15:07:18,913 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 15:07:18,915 INFO [rs(jenkins-hbase4.apache.org,34279,1690124809505)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemState/37431119a48c0015daed4bf9da306560/.tmp/cf/e3711f2dcd62400faeb61511f56904c5 2023-07-23 15:07:18,920 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemState/ddd70301dc9d0734f50cc6b3d6ee482e/.tmp/cf/5321420e96a0460db300919cbaf9e9d2 as hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemState/ddd70301dc9d0734f50cc6b3d6ee482e/cf/5321420e96a0460db300919cbaf9e9d2 2023-07-23 15:07:18,927 DEBUG [rs(jenkins-hbase4.apache.org,34279,1690124809505)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemState/37431119a48c0015daed4bf9da306560/.tmp/cf/e3711f2dcd62400faeb61511f56904c5 as hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemState/37431119a48c0015daed4bf9da306560/cf/e3711f2dcd62400faeb61511f56904c5 2023-07-23 15:07:18,930 INFO [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemState/ddd70301dc9d0734f50cc6b3d6ee482e/cf/5321420e96a0460db300919cbaf9e9d2, entries=47, sequenceid=6, filesize=8.0 K 2023-07-23 15:07:18,933 INFO [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for ddd70301dc9d0734f50cc6b3d6ee482e in 58ms, sequenceid=6, compaction requested=false 2023-07-23 15:07:18,933 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-23 15:07:18,934 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ddd70301dc9d0734f50cc6b3d6ee482e: 2023-07-23 15:07:18,934 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1690124836943.ddd70301dc9d0734f50cc6b3d6ee482e.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-23 15:07:18,934 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 15:07:18,934 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemState/ddd70301dc9d0734f50cc6b3d6ee482e/cf/5321420e96a0460db300919cbaf9e9d2] hfiles 2023-07-23 15:07:18,934 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemState/ddd70301dc9d0734f50cc6b3d6ee482e/cf/5321420e96a0460db300919cbaf9e9d2 for snapshot=snaptb0-testExportFileSystemState 2023-07-23 15:07:18,942 INFO [rs(jenkins-hbase4.apache.org,34279,1690124809505)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemState/37431119a48c0015daed4bf9da306560/cf/e3711f2dcd62400faeb61511f56904c5, entries=3, sequenceid=6, filesize=5.0 K 2023-07-23 15:07:18,961 INFO [rs(jenkins-hbase4.apache.org,34279,1690124809505)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 37431119a48c0015daed4bf9da306560 in 80ms, sequenceid=6, compaction requested=false 2023-07-23 15:07:18,963 DEBUG [rs(jenkins-hbase4.apache.org,34279,1690124809505)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 37431119a48c0015daed4bf9da306560: 2023-07-23 15:07:18,963 DEBUG [rs(jenkins-hbase4.apache.org,34279,1690124809505)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1690124836943.37431119a48c0015daed4bf9da306560.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-23 15:07:18,963 DEBUG [rs(jenkins-hbase4.apache.org,34279,1690124809505)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 15:07:18,963 DEBUG [rs(jenkins-hbase4.apache.org,34279,1690124809505)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemState/37431119a48c0015daed4bf9da306560/cf/e3711f2dcd62400faeb61511f56904c5] hfiles 2023-07-23 15:07:18,963 DEBUG [rs(jenkins-hbase4.apache.org,34279,1690124809505)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemState/37431119a48c0015daed4bf9da306560/cf/e3711f2dcd62400faeb61511f56904c5 for snapshot=snaptb0-testExportFileSystemState 2023-07-23 15:07:18,974 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1690124836943.ddd70301dc9d0734f50cc6b3d6ee482e. completed. 2023-07-23 15:07:18,974 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1690124836943.ddd70301dc9d0734f50cc6b3d6ee482e. 2023-07-23 15:07:18,974 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 15:07:18,975 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 15:07:18,975 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:18,975 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-23 15:07:18,975 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46239,1690124809597' in zk 2023-07-23 15:07:18,979 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-23 15:07:18,979 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:18,979 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:07:18,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:18,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:07:18,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:07:18,980 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-23 15:07:18,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:07:18,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:07:18,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-23 15:07:18,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:18,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:18,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:18,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:07:18,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-23 15:07:18,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:18,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:18,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,46239,1690124809597': 2023-07-23 15:07:18,987 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46239,1690124809597' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-23 15:07:18,999 DEBUG [rs(jenkins-hbase4.apache.org,34279,1690124809505)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1690124836943.37431119a48c0015daed4bf9da306560. completed. 2023-07-23 15:07:19,000 DEBUG [rs(jenkins-hbase4.apache.org,34279,1690124809505)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1690124836943.37431119a48c0015daed4bf9da306560. 2023-07-23 15:07:19,000 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 15:07:19,000 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 15:07:19,000 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:19,000 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-23 15:07:19,000 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34279,1690124809505' in zk 2023-07-23 15:07:19,002 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-23 15:07:19,002 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:19,002 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:07:19,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:19,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:07:19,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:07:19,002 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-23 15:07:19,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:07:19,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:07:19,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-23 15:07:19,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:19,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:19,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:19,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:07:19,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-23 15:07:19,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:19,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:19,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:19,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,34279,1690124809505': 2023-07-23 15:07:19,008 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34279,1690124809505' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-23 15:07:19,008 INFO [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-23 15:07:19,009 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 15:07:19,009 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 15:07:19,009 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-23 15:07:19,009 INFO [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 15:07:19,011 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,011 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,011 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,011 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,011 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:07:19,011 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,011 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,011 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:07:19,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:07:19,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:07:19,012 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:19,012 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:07:19,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:07:19,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:07:19,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:07:19,013 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:19,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:07:19,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:07:19,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:07:19,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:07:19,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-23 15:07:19,013 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:19,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:07:19,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-23 15:07:19,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:19,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:19,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:19,016 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:19,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:07:19,016 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:19,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-23 15:07:19,016 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:19,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:19,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:19,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:19,020 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:07:19,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:07:19,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:07:19,020 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:07:19,020 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:07:19,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:07:19,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:07:19,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:07:19,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:07:19,020 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:07:19,020 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:07:19,020 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:07:19,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:07:19,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:07:19,021 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:07:19,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:07:19,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:07:19,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:07:19,022 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:19,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:07:19,021 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-23 15:07:19,023 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,023 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-23 15:07:19,023 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:19,023 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:19,023 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,023 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:19,023 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,023 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:19,023 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:19,023 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,023 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,024 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,056 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,081 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-23 15:07:19,081 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,081 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,081 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1690124838810Consolidate snapshot: snaptb0-testExportFileSystemState at 1690124839023 (+213 ms)Loading Region manifests for snaptb0-testExportFileSystemState at 1690124839023Writing data manifest for snaptb0-testExportFileSystemState at 1690124839029 (+6 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1690124839046 (+17 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1690124839081 (+35 ms) 2023-07-23 15:07:19,084 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-23 15:07:19,087 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 273 msec 2023-07-23 15:07:19,113 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 15:07:19,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 15:07:19,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 15:07:19,117 INFO [Listener at jenkins-hbase4.apache.org/33035] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/export-test/export-1690124839117 2023-07-23 15:07:19,117 INFO [Listener at jenkins-hbase4.apache.org/33035] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:45535, tgtDir=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/export-test/export-1690124839117, rawTgtDir=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/export-test/export-1690124839117, srcFsUri=hdfs://localhost:45535, srcDir=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40 2023-07-23 15:07:19,149 DEBUG [Listener at jenkins-hbase4.apache.org/33035] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45535, inputRoot=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40 2023-07-23 15:07:19,149 DEBUG [Listener at jenkins-hbase4.apache.org/33035] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1376350605_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/export-test/export-1690124839117, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/export-test/export-1690124839117/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,149 INFO [Listener at jenkins-hbase4.apache.org/33035] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45535, inputRoot=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40, snapshotDir=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-23 15:07:19,165 INFO [Listener at jenkins-hbase4.apache.org/33035] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/export-test/export-1690124839117/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,219 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:19,220 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:19,221 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:19,221 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:19,222 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:19,222 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:19,223 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:19,305 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/hadoop-351657097519237444.jar 2023-07-23 15:07:19,306 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:19,306 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:19,307 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:19,307 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:19,308 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:19,308 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:19,308 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-23 15:07:19,309 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-23 15:07:19,309 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-23 15:07:19,310 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-23 15:07:19,310 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-23 15:07:19,311 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-23 15:07:19,311 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-23 15:07:19,312 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-23 15:07:19,312 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-23 15:07:19,313 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-23 15:07:19,314 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 15:07:19,314 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 15:07:19,315 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 15:07:19,315 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 15:07:19,315 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 15:07:19,316 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 15:07:19,316 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 15:07:20,381 WARN [Listener at jenkins-hbase4.apache.org/33035] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-23 15:07:20,384 INFO [Listener at jenkins-hbase4.apache.org/33035] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-23 15:07:20,386 DEBUG [Listener at jenkins-hbase4.apache.org/33035] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-23 15:07:21,442 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 15:07:21,443 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 15:07:21,449 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690124817489_0001_000001 (auth:SIMPLE) 2023-07-23 15:07:21,824 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690124817489_0002_000001 (auth:SIMPLE) 2023-07-23 15:07:22,209 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-23 15:07:26,567 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690124817489_0002_000001 (auth:SIMPLE) 2023-07-23 15:07:28,814 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690124817489_0002_000001 (auth:SIMPLE) 2023-07-23 15:07:31,799 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690124817489_0002_000001 (auth:SIMPLE) 2023-07-23 15:07:33,579 INFO [Listener at jenkins-hbase4.apache.org/33035] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-23 15:07:33,580 INFO [Listener at jenkins-hbase4.apache.org/33035] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-23 15:07:33,587 INFO [Listener at jenkins-hbase4.apache.org/33035] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-23 15:07:33,588 INFO [Listener at jenkins-hbase4.apache.org/33035] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-23 15:07:33,588 INFO [Listener at jenkins-hbase4.apache.org/33035] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-23 15:07:33,588 DEBUG [Listener at jenkins-hbase4.apache.org/33035] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-979742745_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-23 15:07:33,589 DEBUG [Listener at jenkins-hbase4.apache.org/33035] snapshot.TestExportSnapshot(367): hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-23 15:07:33,589 DEBUG [Listener at jenkins-hbase4.apache.org/33035] snapshot.TestExportSnapshot(367): hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-23 15:07:33,589 DEBUG [Listener at jenkins-hbase4.apache.org/33035] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-979742745_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/export-test/export-1690124839117/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/export-test/export-1690124839117/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-23 15:07:33,590 DEBUG [Listener at jenkins-hbase4.apache.org/33035] snapshot.TestExportSnapshot(367): hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/export-test/export-1690124839117/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-23 15:07:33,590 DEBUG [Listener at jenkins-hbase4.apache.org/33035] snapshot.TestExportSnapshot(367): hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/export-test/export-1690124839117/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-23 15:07:33,597 INFO [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-23 15:07:33,597 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-23 15:07:33,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-23 15:07:33,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-23 15:07:33,603 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690124853603"}]},"ts":"1690124853603"} 2023-07-23 15:07:33,604 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-23 15:07:33,606 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-23 15:07:33,607 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=37431119a48c0015daed4bf9da306560, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ddd70301dc9d0734f50cc6b3d6ee482e, UNASSIGN}] 2023-07-23 15:07:33,609 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ddd70301dc9d0734f50cc6b3d6ee482e, UNASSIGN 2023-07-23 15:07:33,610 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=37431119a48c0015daed4bf9da306560, UNASSIGN 2023-07-23 15:07:33,610 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=ddd70301dc9d0734f50cc6b3d6ee482e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:33,610 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1690124836943.ddd70301dc9d0734f50cc6b3d6ee482e.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690124853610"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690124853610"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690124853610"}]},"ts":"1690124853610"} 2023-07-23 15:07:33,610 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=37431119a48c0015daed4bf9da306560, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:33,611 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1690124836943.37431119a48c0015daed4bf9da306560.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690124853610"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690124853610"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690124853610"}]},"ts":"1690124853610"} 2023-07-23 15:07:33,612 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure ddd70301dc9d0734f50cc6b3d6ee482e, server=jenkins-hbase4.apache.org,46239,1690124809597}] 2023-07-23 15:07:33,613 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure 37431119a48c0015daed4bf9da306560, server=jenkins-hbase4.apache.org,34279,1690124809505}] 2023-07-23 15:07:33,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-23 15:07:33,764 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 37431119a48c0015daed4bf9da306560 2023-07-23 15:07:33,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 37431119a48c0015daed4bf9da306560, disabling compactions & flushes 2023-07-23 15:07:33,765 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1690124836943.37431119a48c0015daed4bf9da306560. 2023-07-23 15:07:33,765 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1690124836943.37431119a48c0015daed4bf9da306560. 2023-07-23 15:07:33,765 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1690124836943.37431119a48c0015daed4bf9da306560. after waiting 0 ms 2023-07-23 15:07:33,765 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1690124836943.37431119a48c0015daed4bf9da306560. 2023-07-23 15:07:33,765 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ddd70301dc9d0734f50cc6b3d6ee482e 2023-07-23 15:07:33,765 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ddd70301dc9d0734f50cc6b3d6ee482e, disabling compactions & flushes 2023-07-23 15:07:33,765 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1690124836943.ddd70301dc9d0734f50cc6b3d6ee482e. 2023-07-23 15:07:33,765 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1690124836943.ddd70301dc9d0734f50cc6b3d6ee482e. 2023-07-23 15:07:33,765 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1690124836943.ddd70301dc9d0734f50cc6b3d6ee482e. after waiting 0 ms 2023-07-23 15:07:33,765 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1690124836943.ddd70301dc9d0734f50cc6b3d6ee482e. 2023-07-23 15:07:33,788 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemState/ddd70301dc9d0734f50cc6b3d6ee482e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 15:07:33,789 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemState/37431119a48c0015daed4bf9da306560/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 15:07:33,789 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 15:07:33,790 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1690124836943.ddd70301dc9d0734f50cc6b3d6ee482e. 2023-07-23 15:07:33,790 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ddd70301dc9d0734f50cc6b3d6ee482e: 2023-07-23 15:07:33,793 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ddd70301dc9d0734f50cc6b3d6ee482e 2023-07-23 15:07:33,793 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 15:07:33,794 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1690124836943.37431119a48c0015daed4bf9da306560. 2023-07-23 15:07:33,794 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 37431119a48c0015daed4bf9da306560: 2023-07-23 15:07:33,795 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=ddd70301dc9d0734f50cc6b3d6ee482e, regionState=CLOSED 2023-07-23 15:07:33,795 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1690124836943.ddd70301dc9d0734f50cc6b3d6ee482e.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690124853795"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690124853795"}]},"ts":"1690124853795"} 2023-07-23 15:07:33,796 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 37431119a48c0015daed4bf9da306560 2023-07-23 15:07:33,821 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=37431119a48c0015daed4bf9da306560, regionState=CLOSED 2023-07-23 15:07:33,822 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1690124836943.37431119a48c0015daed4bf9da306560.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690124853821"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690124853821"}]},"ts":"1690124853821"} 2023-07-23 15:07:33,824 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=38 2023-07-23 15:07:33,824 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure ddd70301dc9d0734f50cc6b3d6ee482e, server=jenkins-hbase4.apache.org,46239,1690124809597 in 210 msec 2023-07-23 15:07:33,826 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=37 2023-07-23 15:07:33,826 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure 37431119a48c0015daed4bf9da306560, server=jenkins-hbase4.apache.org,34279,1690124809505 in 211 msec 2023-07-23 15:07:33,828 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ddd70301dc9d0734f50cc6b3d6ee482e, UNASSIGN in 217 msec 2023-07-23 15:07:33,829 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-07-23 15:07:33,829 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=37431119a48c0015daed4bf9da306560, UNASSIGN in 219 msec 2023-07-23 15:07:33,830 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690124853830"}]},"ts":"1690124853830"} 2023-07-23 15:07:33,832 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-23 15:07:33,834 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-23 15:07:33,836 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 237 msec 2023-07-23 15:07:33,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-23 15:07:33,905 INFO [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-23 15:07:33,906 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-23 15:07:33,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-23 15:07:33,910 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-23 15:07:33,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-23 15:07:33,911 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-23 15:07:33,912 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34279] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-23 15:07:33,916 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-23 15:07:33,916 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemState/37431119a48c0015daed4bf9da306560 2023-07-23 15:07:33,916 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemState/ddd70301dc9d0734f50cc6b3d6ee482e 2023-07-23 15:07:33,916 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-23 15:07:33,916 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-23 15:07:33,916 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-23 15:07:33,917 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-23 15:07:33,917 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-23 15:07:33,918 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-23 15:07:33,918 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-23 15:07:33,918 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:07:33,918 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:07:33,918 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data null 2023-07-23 15:07:33,918 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:07:33,918 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-23 15:07:33,918 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data null 2023-07-23 15:07:33,918 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:07:33,918 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-23 15:07:33,919 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemState/ddd70301dc9d0734f50cc6b3d6ee482e/cf, FileablePath, hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemState/ddd70301dc9d0734f50cc6b3d6ee482e/recovered.edits] 2023-07-23 15:07:33,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-23 15:07:33,919 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemState/37431119a48c0015daed4bf9da306560/cf, FileablePath, hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemState/37431119a48c0015daed4bf9da306560/recovered.edits] 2023-07-23 15:07:33,925 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemState/ddd70301dc9d0734f50cc6b3d6ee482e/cf/5321420e96a0460db300919cbaf9e9d2 to hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/archive/data/default/testtb-testExportFileSystemState/ddd70301dc9d0734f50cc6b3d6ee482e/cf/5321420e96a0460db300919cbaf9e9d2 2023-07-23 15:07:33,925 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemState/37431119a48c0015daed4bf9da306560/cf/e3711f2dcd62400faeb61511f56904c5 to hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/archive/data/default/testtb-testExportFileSystemState/37431119a48c0015daed4bf9da306560/cf/e3711f2dcd62400faeb61511f56904c5 2023-07-23 15:07:33,929 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemState/ddd70301dc9d0734f50cc6b3d6ee482e/recovered.edits/9.seqid to hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/archive/data/default/testtb-testExportFileSystemState/ddd70301dc9d0734f50cc6b3d6ee482e/recovered.edits/9.seqid 2023-07-23 15:07:33,929 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemState/37431119a48c0015daed4bf9da306560/recovered.edits/9.seqid to hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/archive/data/default/testtb-testExportFileSystemState/37431119a48c0015daed4bf9da306560/recovered.edits/9.seqid 2023-07-23 15:07:33,930 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemState/ddd70301dc9d0734f50cc6b3d6ee482e 2023-07-23 15:07:33,930 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemState/37431119a48c0015daed4bf9da306560 2023-07-23 15:07:33,930 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-23 15:07:33,933 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-23 15:07:33,936 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-23 15:07:33,938 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-23 15:07:33,940 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-23 15:07:33,940 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-23 15:07:33,940 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1690124836943.37431119a48c0015daed4bf9da306560.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690124853940"}]},"ts":"9223372036854775807"} 2023-07-23 15:07:33,940 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1690124836943.ddd70301dc9d0734f50cc6b3d6ee482e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690124853940"}]},"ts":"9223372036854775807"} 2023-07-23 15:07:33,942 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-23 15:07:33,942 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 37431119a48c0015daed4bf9da306560, NAME => 'testtb-testExportFileSystemState,,1690124836943.37431119a48c0015daed4bf9da306560.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => ddd70301dc9d0734f50cc6b3d6ee482e, NAME => 'testtb-testExportFileSystemState,1,1690124836943.ddd70301dc9d0734f50cc6b3d6ee482e.', STARTKEY => '1', ENDKEY => ''}] 2023-07-23 15:07:33,942 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-23 15:07:33,942 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690124853942"}]},"ts":"9223372036854775807"} 2023-07-23 15:07:33,944 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-23 15:07:33,946 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-23 15:07:33,948 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 40 msec 2023-07-23 15:07:34,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-23 15:07:34,021 INFO [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-23 15:07:34,029 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-23 15:07:34,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:34,033 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-23 15:07:34,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-23 15:07:34,060 INFO [Listener at jenkins-hbase4.apache.org/33035] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=765 (was 755) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1949 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-979742745_17 at /127.0.0.1:50730 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3d9205bb-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3d9205bb-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-979742745_17 at /127.0.0.1:49918 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3d9205bb-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3d9205bb-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-979742745_17 at /127.0.0.1:53398 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (449583813) connection to jenkins-hbase4.apache.org/172.31.14.131:46111 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_149342116_1 at /127.0.0.1:49912 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_149342116_1 at /127.0.0.1:53372 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=917 (was 916) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=275 (was 199) - SystemLoadAverage LEAK? -, ProcessCount=179 (was 179), AvailableMemoryMB=6279 (was 6569) 2023-07-23 15:07:34,061 WARN [Listener at jenkins-hbase4.apache.org/33035] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-07-23 15:07:34,081 INFO [Listener at jenkins-hbase4.apache.org/33035] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=765, OpenFileDescriptor=917, MaxFileDescriptor=60000, SystemLoadAverage=275, ProcessCount=179, AvailableMemoryMB=6278 2023-07-23 15:07:34,081 WARN [Listener at jenkins-hbase4.apache.org/33035] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-07-23 15:07:34,083 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-23 15:07:34,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-23 15:07:34,088 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-23 15:07:34,088 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-23 15:07:34,089 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-23 15:07:34,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-23 15:07:34,092 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testConsecutiveExports/377289208bd726e15fc847fa65b4f556 2023-07-23 15:07:34,092 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testConsecutiveExports/4ebcfbb462d5f4df9ca9e3f8987fa8f9 2023-07-23 15:07:34,092 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testConsecutiveExports/377289208bd726e15fc847fa65b4f556 empty. 2023-07-23 15:07:34,092 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testConsecutiveExports/4ebcfbb462d5f4df9ca9e3f8987fa8f9 empty. 2023-07-23 15:07:34,093 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testConsecutiveExports/377289208bd726e15fc847fa65b4f556 2023-07-23 15:07:34,094 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testConsecutiveExports/4ebcfbb462d5f4df9ca9e3f8987fa8f9 2023-07-23 15:07:34,094 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-23 15:07:34,126 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-23 15:07:34,127 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 377289208bd726e15fc847fa65b4f556, NAME => 'testtb-testConsecutiveExports,,1690124854083.377289208bd726e15fc847fa65b4f556.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp 2023-07-23 15:07:34,135 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 4ebcfbb462d5f4df9ca9e3f8987fa8f9, NAME => 'testtb-testConsecutiveExports,1,1690124854083.4ebcfbb462d5f4df9ca9e3f8987fa8f9.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp 2023-07-23 15:07:34,164 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1690124854083.377289208bd726e15fc847fa65b4f556.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:07:34,165 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 377289208bd726e15fc847fa65b4f556, disabling compactions & flushes 2023-07-23 15:07:34,165 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1690124854083.377289208bd726e15fc847fa65b4f556. 2023-07-23 15:07:34,165 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1690124854083.377289208bd726e15fc847fa65b4f556. 2023-07-23 15:07:34,165 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1690124854083.377289208bd726e15fc847fa65b4f556. after waiting 0 ms 2023-07-23 15:07:34,165 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1690124854083.377289208bd726e15fc847fa65b4f556. 2023-07-23 15:07:34,165 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1690124854083.377289208bd726e15fc847fa65b4f556. 2023-07-23 15:07:34,165 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 377289208bd726e15fc847fa65b4f556: 2023-07-23 15:07:34,172 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1690124854083.4ebcfbb462d5f4df9ca9e3f8987fa8f9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:07:34,172 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 4ebcfbb462d5f4df9ca9e3f8987fa8f9, disabling compactions & flushes 2023-07-23 15:07:34,172 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1690124854083.4ebcfbb462d5f4df9ca9e3f8987fa8f9. 2023-07-23 15:07:34,172 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1690124854083.4ebcfbb462d5f4df9ca9e3f8987fa8f9. 2023-07-23 15:07:34,173 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1690124854083.4ebcfbb462d5f4df9ca9e3f8987fa8f9. after waiting 0 ms 2023-07-23 15:07:34,173 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1690124854083.4ebcfbb462d5f4df9ca9e3f8987fa8f9. 2023-07-23 15:07:34,173 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1690124854083.4ebcfbb462d5f4df9ca9e3f8987fa8f9. 2023-07-23 15:07:34,173 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 4ebcfbb462d5f4df9ca9e3f8987fa8f9: 2023-07-23 15:07:34,178 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-23 15:07:34,179 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1690124854083.377289208bd726e15fc847fa65b4f556.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690124854179"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690124854179"}]},"ts":"1690124854179"} 2023-07-23 15:07:34,179 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1690124854083.4ebcfbb462d5f4df9ca9e3f8987fa8f9.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690124854179"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690124854179"}]},"ts":"1690124854179"} 2023-07-23 15:07:34,181 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-23 15:07:34,182 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-23 15:07:34,183 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690124854182"}]},"ts":"1690124854182"} 2023-07-23 15:07:34,184 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-23 15:07:34,189 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-23 15:07:34,190 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-23 15:07:34,190 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-23 15:07:34,190 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-23 15:07:34,190 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-23 15:07:34,191 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=377289208bd726e15fc847fa65b4f556, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=4ebcfbb462d5f4df9ca9e3f8987fa8f9, ASSIGN}] 2023-07-23 15:07:34,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-23 15:07:34,197 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=377289208bd726e15fc847fa65b4f556, ASSIGN 2023-07-23 15:07:34,197 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=4ebcfbb462d5f4df9ca9e3f8987fa8f9, ASSIGN 2023-07-23 15:07:34,199 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=377289208bd726e15fc847fa65b4f556, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46191,1690124809654; forceNewPlan=false, retain=false 2023-07-23 15:07:34,199 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=4ebcfbb462d5f4df9ca9e3f8987fa8f9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46239,1690124809597; forceNewPlan=false, retain=false 2023-07-23 15:07:34,349 INFO [jenkins-hbase4:38379] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-23 15:07:34,352 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=4ebcfbb462d5f4df9ca9e3f8987fa8f9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:34,352 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=377289208bd726e15fc847fa65b4f556, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:34,352 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1690124854083.4ebcfbb462d5f4df9ca9e3f8987fa8f9.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690124854352"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690124854352"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690124854352"}]},"ts":"1690124854352"} 2023-07-23 15:07:34,352 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1690124854083.377289208bd726e15fc847fa65b4f556.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690124854352"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690124854352"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690124854352"}]},"ts":"1690124854352"} 2023-07-23 15:07:34,354 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure 4ebcfbb462d5f4df9ca9e3f8987fa8f9, server=jenkins-hbase4.apache.org,46239,1690124809597}] 2023-07-23 15:07:34,355 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure 377289208bd726e15fc847fa65b4f556, server=jenkins-hbase4.apache.org,46191,1690124809654}] 2023-07-23 15:07:34,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-23 15:07:34,512 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1690124854083.4ebcfbb462d5f4df9ca9e3f8987fa8f9. 2023-07-23 15:07:34,512 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4ebcfbb462d5f4df9ca9e3f8987fa8f9, NAME => 'testtb-testConsecutiveExports,1,1690124854083.4ebcfbb462d5f4df9ca9e3f8987fa8f9.', STARTKEY => '1', ENDKEY => ''} 2023-07-23 15:07:34,513 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1690124854083.4ebcfbb462d5f4df9ca9e3f8987fa8f9. service=AccessControlService 2023-07-23 15:07:34,513 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 15:07:34,513 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 4ebcfbb462d5f4df9ca9e3f8987fa8f9 2023-07-23 15:07:34,513 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1690124854083.4ebcfbb462d5f4df9ca9e3f8987fa8f9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:07:34,513 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1690124854083.377289208bd726e15fc847fa65b4f556. 2023-07-23 15:07:34,513 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4ebcfbb462d5f4df9ca9e3f8987fa8f9 2023-07-23 15:07:34,513 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4ebcfbb462d5f4df9ca9e3f8987fa8f9 2023-07-23 15:07:34,513 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 377289208bd726e15fc847fa65b4f556, NAME => 'testtb-testConsecutiveExports,,1690124854083.377289208bd726e15fc847fa65b4f556.', STARTKEY => '', ENDKEY => '1'} 2023-07-23 15:07:34,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1690124854083.377289208bd726e15fc847fa65b4f556. service=AccessControlService 2023-07-23 15:07:34,514 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 15:07:34,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 377289208bd726e15fc847fa65b4f556 2023-07-23 15:07:34,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1690124854083.377289208bd726e15fc847fa65b4f556.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:07:34,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 377289208bd726e15fc847fa65b4f556 2023-07-23 15:07:34,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 377289208bd726e15fc847fa65b4f556 2023-07-23 15:07:34,514 INFO [StoreOpener-4ebcfbb462d5f4df9ca9e3f8987fa8f9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4ebcfbb462d5f4df9ca9e3f8987fa8f9 2023-07-23 15:07:34,515 INFO [StoreOpener-377289208bd726e15fc847fa65b4f556-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 377289208bd726e15fc847fa65b4f556 2023-07-23 15:07:34,516 DEBUG [StoreOpener-4ebcfbb462d5f4df9ca9e3f8987fa8f9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testConsecutiveExports/4ebcfbb462d5f4df9ca9e3f8987fa8f9/cf 2023-07-23 15:07:34,516 DEBUG [StoreOpener-4ebcfbb462d5f4df9ca9e3f8987fa8f9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testConsecutiveExports/4ebcfbb462d5f4df9ca9e3f8987fa8f9/cf 2023-07-23 15:07:34,517 INFO [StoreOpener-4ebcfbb462d5f4df9ca9e3f8987fa8f9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4ebcfbb462d5f4df9ca9e3f8987fa8f9 columnFamilyName cf 2023-07-23 15:07:34,517 DEBUG [StoreOpener-377289208bd726e15fc847fa65b4f556-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testConsecutiveExports/377289208bd726e15fc847fa65b4f556/cf 2023-07-23 15:07:34,517 DEBUG [StoreOpener-377289208bd726e15fc847fa65b4f556-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testConsecutiveExports/377289208bd726e15fc847fa65b4f556/cf 2023-07-23 15:07:34,517 INFO [StoreOpener-4ebcfbb462d5f4df9ca9e3f8987fa8f9-1] regionserver.HStore(310): Store=4ebcfbb462d5f4df9ca9e3f8987fa8f9/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 15:07:34,517 INFO [StoreOpener-377289208bd726e15fc847fa65b4f556-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 377289208bd726e15fc847fa65b4f556 columnFamilyName cf 2023-07-23 15:07:34,518 INFO [StoreOpener-377289208bd726e15fc847fa65b4f556-1] regionserver.HStore(310): Store=377289208bd726e15fc847fa65b4f556/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 15:07:34,518 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testConsecutiveExports/4ebcfbb462d5f4df9ca9e3f8987fa8f9 2023-07-23 15:07:34,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testConsecutiveExports/4ebcfbb462d5f4df9ca9e3f8987fa8f9 2023-07-23 15:07:34,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testConsecutiveExports/377289208bd726e15fc847fa65b4f556 2023-07-23 15:07:34,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testConsecutiveExports/377289208bd726e15fc847fa65b4f556 2023-07-23 15:07:34,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4ebcfbb462d5f4df9ca9e3f8987fa8f9 2023-07-23 15:07:34,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 377289208bd726e15fc847fa65b4f556 2023-07-23 15:07:34,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testConsecutiveExports/4ebcfbb462d5f4df9ca9e3f8987fa8f9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 15:07:34,524 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4ebcfbb462d5f4df9ca9e3f8987fa8f9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75204909, jitterRate=0.12064047157764435}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 15:07:34,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4ebcfbb462d5f4df9ca9e3f8987fa8f9: 2023-07-23 15:07:34,525 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1690124854083.4ebcfbb462d5f4df9ca9e3f8987fa8f9., pid=45, masterSystemTime=1690124854506 2023-07-23 15:07:34,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testConsecutiveExports/377289208bd726e15fc847fa65b4f556/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 15:07:34,525 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 377289208bd726e15fc847fa65b4f556; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68134119, jitterRate=0.015277490019798279}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 15:07:34,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 377289208bd726e15fc847fa65b4f556: 2023-07-23 15:07:34,526 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1690124854083.377289208bd726e15fc847fa65b4f556., pid=46, masterSystemTime=1690124854507 2023-07-23 15:07:34,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1690124854083.4ebcfbb462d5f4df9ca9e3f8987fa8f9. 2023-07-23 15:07:34,527 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1690124854083.4ebcfbb462d5f4df9ca9e3f8987fa8f9. 2023-07-23 15:07:34,527 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=4ebcfbb462d5f4df9ca9e3f8987fa8f9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:34,528 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1690124854083.4ebcfbb462d5f4df9ca9e3f8987fa8f9.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690124854527"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690124854527"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690124854527"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690124854527"}]},"ts":"1690124854527"} 2023-07-23 15:07:34,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1690124854083.377289208bd726e15fc847fa65b4f556. 2023-07-23 15:07:34,528 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1690124854083.377289208bd726e15fc847fa65b4f556. 2023-07-23 15:07:34,529 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=377289208bd726e15fc847fa65b4f556, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:34,529 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1690124854083.377289208bd726e15fc847fa65b4f556.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690124854529"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690124854529"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690124854529"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690124854529"}]},"ts":"1690124854529"} 2023-07-23 15:07:34,532 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-07-23 15:07:34,532 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure 4ebcfbb462d5f4df9ca9e3f8987fa8f9, server=jenkins-hbase4.apache.org,46239,1690124809597 in 176 msec 2023-07-23 15:07:34,533 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=43 2023-07-23 15:07:34,533 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure 377289208bd726e15fc847fa65b4f556, server=jenkins-hbase4.apache.org,46191,1690124809654 in 176 msec 2023-07-23 15:07:34,534 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=4ebcfbb462d5f4df9ca9e3f8987fa8f9, ASSIGN in 341 msec 2023-07-23 15:07:34,535 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=42 2023-07-23 15:07:34,535 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=377289208bd726e15fc847fa65b4f556, ASSIGN in 343 msec 2023-07-23 15:07:34,536 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-23 15:07:34,536 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690124854536"}]},"ts":"1690124854536"} 2023-07-23 15:07:34,537 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-23 15:07:34,539 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-23 15:07:34,539 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-23 15:07:34,541 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34279] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-23 15:07:34,543 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:07:34,543 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:07:34,543 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:07:34,543 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:07:34,544 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-23 15:07:34,544 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-23 15:07:34,544 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-23 15:07:34,544 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-23 15:07:34,546 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 461 msec 2023-07-23 15:07:34,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-23 15:07:34,694 INFO [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-23 15:07:34,694 DEBUG [Listener at jenkins-hbase4.apache.org/33035] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testConsecutiveExports get assigned. Timeout = 60000ms 2023-07-23 15:07:34,694 INFO [Listener at jenkins-hbase4.apache.org/33035] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 15:07:34,698 INFO [Listener at jenkins-hbase4.apache.org/33035] hbase.HBaseTestingUtility(3484): All regions for table testtb-testConsecutiveExports assigned to meta. Checking AM states. 2023-07-23 15:07:34,698 INFO [Listener at jenkins-hbase4.apache.org/33035] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 15:07:34,698 INFO [Listener at jenkins-hbase4.apache.org/33035] hbase.HBaseTestingUtility(3504): All regions for table testtb-testConsecutiveExports assigned. 2023-07-23 15:07:34,701 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-23 15:07:34,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690124854701 (current time:1690124854701). 2023-07-23 15:07:34,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 15:07:34,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] zookeeper.ReadOnlyZKClient(139): Connect 0x7f812041 to 127.0.0.1:51019 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 15:07:34,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@51d517f4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 15:07:34,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:07:34,713 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35720, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:07:34,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7f812041 to 127.0.0.1:51019 2023-07-23 15:07:34,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 15:07:34,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] zookeeper.ReadOnlyZKClient(139): Connect 0x21921063 to 127.0.0.1:51019 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 15:07:34,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5767af38, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 15:07:34,722 DEBUG [hconnection-0x2ef46897-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:07:34,725 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35736, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:07:34,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x21921063 to 127.0.0.1:51019 2023-07-23 15:07:34,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 15:07:34,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-23 15:07:34,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 15:07:34,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-23 15:07:34,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-23 15:07:34,736 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-23 15:07:34,737 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1690125454737 2023-07-23 15:07:34,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-23 15:07:34,737 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-23 15:07:34,739 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 15:07:34,739 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 15:07:34,743 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-23 15:07:34,743 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-23 15:07:34,747 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 9 msec 2023-07-23 15:07:34,748 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-23 15:07:34,754 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1690125454754 2023-07-23 15:07:34,763 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,763 INFO [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-23 15:07:34,763 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:07:34,765 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-23 15:07:34,765 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-23 15:07:34,765 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,765 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,768 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:07:34,768 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:07:34,768 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:07:34,768 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:07:34,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:07:34,768 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:07:34,768 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:34,768 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:07:34,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:07:34,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:07:34,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,768 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:34,768 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:34,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,769 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,769 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:34,769 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 15:07:34,769 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,769 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-23 15:07:34,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,769 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-23 15:07:34,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-23 15:07:34,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-23 15:07:34,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,769 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-23 15:07:34,769 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,769 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-23 15:07:34,770 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-23 15:07:34,770 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,770 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:07:34,770 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-23 15:07:34,771 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-23 15:07:34,771 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-23 15:07:34,771 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:07:34,771 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34279,1690124809505' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-23 15:07:34,772 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-23 15:07:34,772 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-23 15:07:34,772 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46191,1690124809654' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-23 15:07:34,770 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,772 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-23 15:07:34,772 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:07:34,775 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-23 15:07:34,775 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-23 15:07:34,775 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46239,1690124809597' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-23 15:07:34,776 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,777 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:34,777 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:34,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:07:34,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:07:34,778 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:34,778 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,778 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,778 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:07:34,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:07:34,778 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,778 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:07:34,778 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,778 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:07:34,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:07:34,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:34,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:34,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:34,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:07:34,780 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46191,1690124809654' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-23 15:07:34,780 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@286de257[Count = 1] remaining members to acquire global barrier 2023-07-23 15:07:34,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:34,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:07:34,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:07:34,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:07:34,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:07:34,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:34,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:34,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:34,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:07:34,782 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46239,1690124809597' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-23 15:07:34,783 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@286de257[Count = 0] remaining members to acquire global barrier 2023-07-23 15:07:34,783 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-23 15:07:34,783 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,789 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,789 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,789 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,789 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:34,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,789 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-23 15:07:34,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,789 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 15:07:34,789 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-23 15:07:34,790 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:34,790 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 15:07:34,789 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-23 15:07:34,790 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1690124854083.4ebcfbb462d5f4df9ca9e3f8987fa8f9. 2023-07-23 15:07:34,790 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-23 15:07:34,790 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1690124854083.4ebcfbb462d5f4df9ca9e3f8987fa8f9. started... 2023-07-23 15:07:34,790 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 15:07:34,790 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 15:07:34,790 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 15:07:34,790 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,34279,1690124809505' in zk 2023-07-23 15:07:34,790 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1690124854083.377289208bd726e15fc847fa65b4f556. 2023-07-23 15:07:34,791 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4ebcfbb462d5f4df9ca9e3f8987fa8f9: 2023-07-23 15:07:34,791 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1690124854083.377289208bd726e15fc847fa65b4f556. started... 2023-07-23 15:07:34,792 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1690124854083.4ebcfbb462d5f4df9ca9e3f8987fa8f9.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,792 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 377289208bd726e15fc847fa65b4f556: 2023-07-23 15:07:34,792 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 15:07:34,793 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 15:07:34,793 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1690124854083.377289208bd726e15fc847fa65b4f556.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,793 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 15:07:34,793 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 15:07:34,798 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-23 15:07:34,798 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:07:34,798 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-23 15:07:34,807 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1690124854083.4ebcfbb462d5f4df9ca9e3f8987fa8f9. completed. 2023-07-23 15:07:34,807 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1690124854083.4ebcfbb462d5f4df9ca9e3f8987fa8f9. 2023-07-23 15:07:34,807 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 15:07:34,807 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 15:07:34,807 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:34,807 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-23 15:07:34,807 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,46239,1690124809597' in zk 2023-07-23 15:07:34,809 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-23 15:07:34,809 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:07:34,809 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:34,809 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-23 15:07:34,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:34,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:07:34,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:07:34,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:07:34,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:07:34,811 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1690124854083.377289208bd726e15fc847fa65b4f556. completed. 2023-07-23 15:07:34,811 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1690124854083.377289208bd726e15fc847fa65b4f556. 2023-07-23 15:07:34,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,811 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 15:07:34,811 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 15:07:34,811 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:34,811 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-23 15:07:34,811 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,46191,1690124809654' in zk 2023-07-23 15:07:34,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:34,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:34,813 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:34,814 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-23 15:07:34,814 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:07:34,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:34,814 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-23 15:07:34,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:07:34,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:34,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:34,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:34,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,46239,1690124809597': 2023-07-23 15:07:34,816 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46239,1690124809597' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-23 15:07:34,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:34,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:07:34,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:07:34,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:07:34,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:07:34,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:34,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:34,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:34,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:07:34,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:34,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:34,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:34,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,46191,1690124809654': 2023-07-23 15:07:34,820 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46191,1690124809654' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-23 15:07:34,820 INFO [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-23 15:07:34,821 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 15:07:34,821 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 15:07:34,821 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,821 INFO [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 15:07:34,823 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,823 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,823 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:07:34,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:07:34,823 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:07:34,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,823 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:07:34,823 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,823 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:34,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:07:34,823 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:07:34,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:07:34,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:07:34,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:07:34,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:07:34,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:07:34,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:07:34,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,824 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:34,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:07:34,824 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:34,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:34,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:34,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:34,826 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:34,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:07:34,826 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:34,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,827 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:34,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:34,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:34,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:34,830 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:34,830 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:07:34,830 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:07:34,830 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:07:34,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:07:34,830 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:07:34,830 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:34,830 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:07:34,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:07:34,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:07:34,830 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:34,830 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,830 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:07:34,831 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:07:34,830 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:07:34,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:07:34,831 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:07:34,830 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:07:34,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:07:34,832 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:34,832 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,832 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:34,832 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:34,832 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,832 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,833 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,833 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:07:34,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:07:34,833 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:07:34,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:07:34,839 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 15:07:34,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-23 15:07:34,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-23 15:07:34,840 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 15:07:34,854 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,874 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-23 15:07:34,874 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,874 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,874 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1690124854738Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1690124854831 (+93 ms)Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1690124854832 (+1 ms)Writing data manifest for emptySnaptb0-testConsecutiveExports at 1690124854839 (+7 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1690124854848 (+9 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1690124854874 (+26 ms) 2023-07-23 15:07:34,877 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-23 15:07:34,881 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 138 msec 2023-07-23 15:07:35,040 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 15:07:35,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-23 15:07:35,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 15:07:35,049 DEBUG [htable-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:07:35,054 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51270, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:07:35,054 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46239] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1690124854083.4ebcfbb462d5f4df9ca9e3f8987fa8f9. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 15:07:35,054 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46191] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1690124854083.377289208bd726e15fc847fa65b4f556. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 15:07:35,059 DEBUG [Listener at jenkins-hbase4.apache.org/33035] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-23 15:07:35,059 DEBUG [Listener at jenkins-hbase4.apache.org/33035] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1690124854083.377289208bd726e15fc847fa65b4f556. 2023-07-23 15:07:35,061 INFO [Listener at jenkins-hbase4.apache.org/33035] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 15:07:35,073 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-23 15:07:35,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690124855074 (current time:1690124855074). 2023-07-23 15:07:35,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 15:07:35,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] zookeeper.ReadOnlyZKClient(139): Connect 0x4f13694a to 127.0.0.1:51019 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 15:07:35,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@11b606a2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 15:07:35,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:07:35,091 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35748, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:07:35,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4f13694a to 127.0.0.1:51019 2023-07-23 15:07:35,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 15:07:35,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] zookeeper.ReadOnlyZKClient(139): Connect 0x7742ebd6 to 127.0.0.1:51019 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 15:07:35,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@234f854d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 15:07:35,104 DEBUG [hconnection-0x26d1490-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:07:35,105 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35756, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:07:35,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7742ebd6 to 127.0.0.1:51019 2023-07-23 15:07:35,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 15:07:35,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-23 15:07:35,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 15:07:35,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-23 15:07:35,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-23 15:07:35,115 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-23 15:07:35,116 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1690125455116 2023-07-23 15:07:35,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-23 15:07:35,116 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-23 15:07:35,117 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 15:07:35,117 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 15:07:35,118 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-23 15:07:35,119 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-23 15:07:35,120 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-07-23 15:07:35,121 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-23 15:07:35,121 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1690125455121 2023-07-23 15:07:35,136 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-23 15:07:35,136 INFO [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-23 15:07:35,136 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:07:35,138 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-23 15:07:35,138 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-23 15:07:35,138 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,138 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,140 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:07:35,140 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:07:35,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:07:35,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:07:35,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:07:35,140 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:07:35,140 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:35,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:07:35,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:07:35,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:07:35,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,141 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:35,141 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:35,141 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,141 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:35,141 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 15:07:35,141 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,141 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-23 15:07:35,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-23 15:07:35,142 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-23 15:07:35,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-23 15:07:35,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,142 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-23 15:07:35,142 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-23 15:07:35,142 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-23 15:07:35,142 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-23 15:07:35,142 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-23 15:07:35,142 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-23 15:07:35,143 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:07:35,142 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:07:35,144 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-23 15:07:35,144 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-23 15:07:35,144 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-23 15:07:35,145 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-23 15:07:35,145 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-23 15:07:35,145 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:07:35,145 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-23 15:07:35,145 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34279,1690124809505' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-23 15:07:35,146 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46239,1690124809597' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-23 15:07:35,146 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-23 15:07:35,147 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-23 15:07:35,147 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46191,1690124809654' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-23 15:07:35,148 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,150 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:35,150 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:35,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:07:35,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:07:35,151 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,151 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,151 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:35,151 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,151 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:07:35,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:07:35,151 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:07:35,151 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,151 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:07:35,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:07:35,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-23 15:07:35,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:35,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:35,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:35,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:07:35,159 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46239,1690124809597' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-23 15:07:35,159 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7f364014[Count = 1] remaining members to acquire global barrier 2023-07-23 15:07:35,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:35,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:07:35,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:07:35,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:07:35,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:07:35,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-23 15:07:35,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:35,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:35,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:35,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:07:35,161 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46191,1690124809654' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-23 15:07:35,162 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7f364014[Count = 0] remaining members to acquire global barrier 2023-07-23 15:07:35,162 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-23 15:07:35,162 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,163 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,163 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,163 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,163 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-23 15:07:35,163 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,163 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-23 15:07:35,163 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,163 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:35,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,164 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-23 15:07:35,164 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-23 15:07:35,164 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,34279,1690124809505' in zk 2023-07-23 15:07:35,164 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:35,164 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 15:07:35,165 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-23 15:07:35,166 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:07:35,166 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-23 15:07:35,173 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 15:07:35,173 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 15:07:35,173 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 15:07:35,173 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 15:07:35,173 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1690124854083.377289208bd726e15fc847fa65b4f556. 2023-07-23 15:07:35,173 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1690124854083.4ebcfbb462d5f4df9ca9e3f8987fa8f9. 2023-07-23 15:07:35,174 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1690124854083.377289208bd726e15fc847fa65b4f556. started... 2023-07-23 15:07:35,174 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1690124854083.4ebcfbb462d5f4df9ca9e3f8987fa8f9. started... 2023-07-23 15:07:35,174 INFO [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 377289208bd726e15fc847fa65b4f556 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-23 15:07:35,174 INFO [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 4ebcfbb462d5f4df9ca9e3f8987fa8f9 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-23 15:07:35,205 INFO [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=266 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testConsecutiveExports/377289208bd726e15fc847fa65b4f556/.tmp/cf/2d6c27a9a442419b97349063d813bef5 2023-07-23 15:07:35,207 INFO [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.00 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testConsecutiveExports/4ebcfbb462d5f4df9ca9e3f8987fa8f9/.tmp/cf/5f20a4ac613d4a698f906038201a7777 2023-07-23 15:07:35,213 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testConsecutiveExports/377289208bd726e15fc847fa65b4f556/.tmp/cf/2d6c27a9a442419b97349063d813bef5 as hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testConsecutiveExports/377289208bd726e15fc847fa65b4f556/cf/2d6c27a9a442419b97349063d813bef5 2023-07-23 15:07:35,215 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testConsecutiveExports/4ebcfbb462d5f4df9ca9e3f8987fa8f9/.tmp/cf/5f20a4ac613d4a698f906038201a7777 as hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testConsecutiveExports/4ebcfbb462d5f4df9ca9e3f8987fa8f9/cf/5f20a4ac613d4a698f906038201a7777 2023-07-23 15:07:35,218 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 15:07:35,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-23 15:07:35,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-23 15:07:35,219 INFO [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testConsecutiveExports/377289208bd726e15fc847fa65b4f556/cf/2d6c27a9a442419b97349063d813bef5, entries=4, sequenceid=6, filesize=5.1 K 2023-07-23 15:07:35,220 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 15:07:35,220 INFO [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 377289208bd726e15fc847fa65b4f556 in 46ms, sequenceid=6, compaction requested=false 2023-07-23 15:07:35,220 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-23 15:07:35,221 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 377289208bd726e15fc847fa65b4f556: 2023-07-23 15:07:35,221 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1690124854083.377289208bd726e15fc847fa65b4f556.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-23 15:07:35,221 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 15:07:35,222 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testConsecutiveExports/377289208bd726e15fc847fa65b4f556/cf/2d6c27a9a442419b97349063d813bef5] hfiles 2023-07-23 15:07:35,222 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testConsecutiveExports/377289208bd726e15fc847fa65b4f556/cf/2d6c27a9a442419b97349063d813bef5 for snapshot=snaptb0-testConsecutiveExports 2023-07-23 15:07:35,222 INFO [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testConsecutiveExports/4ebcfbb462d5f4df9ca9e3f8987fa8f9/cf/5f20a4ac613d4a698f906038201a7777, entries=46, sequenceid=6, filesize=7.9 K 2023-07-23 15:07:35,223 INFO [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 4ebcfbb462d5f4df9ca9e3f8987fa8f9 in 49ms, sequenceid=6, compaction requested=false 2023-07-23 15:07:35,224 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4ebcfbb462d5f4df9ca9e3f8987fa8f9: 2023-07-23 15:07:35,224 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1690124854083.4ebcfbb462d5f4df9ca9e3f8987fa8f9.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-23 15:07:35,224 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 15:07:35,225 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testConsecutiveExports/4ebcfbb462d5f4df9ca9e3f8987fa8f9/cf/5f20a4ac613d4a698f906038201a7777] hfiles 2023-07-23 15:07:35,225 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testConsecutiveExports/4ebcfbb462d5f4df9ca9e3f8987fa8f9/cf/5f20a4ac613d4a698f906038201a7777 for snapshot=snaptb0-testConsecutiveExports 2023-07-23 15:07:35,247 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1690124854083.377289208bd726e15fc847fa65b4f556. completed. 2023-07-23 15:07:35,247 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1690124854083.377289208bd726e15fc847fa65b4f556. 2023-07-23 15:07:35,247 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 15:07:35,247 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 15:07:35,247 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:35,247 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-23 15:07:35,247 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,46191,1690124809654' in zk 2023-07-23 15:07:35,250 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1690124854083.4ebcfbb462d5f4df9ca9e3f8987fa8f9. completed. 2023-07-23 15:07:35,250 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1690124854083.4ebcfbb462d5f4df9ca9e3f8987fa8f9. 2023-07-23 15:07:35,250 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-23 15:07:35,250 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 15:07:35,250 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 15:07:35,250 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:35,250 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:35,250 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-23 15:07:35,250 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,46239,1690124809597' in zk 2023-07-23 15:07:35,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:35,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:07:35,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:07:35,250 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:07:35,250 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-23 15:07:35,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:07:35,253 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:35,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:07:35,253 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-23 15:07:35,253 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:07:35,253 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-23 15:07:35,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-23 15:07:35,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:35,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:35,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:35,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:07:35,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-23 15:07:35,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:35,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:35,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:35,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,46191,1690124809654': 2023-07-23 15:07:35,258 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46191,1690124809654' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-23 15:07:35,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:35,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:07:35,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:07:35,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:07:35,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:07:35,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-23 15:07:35,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:35,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:35,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:35,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:07:35,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-23 15:07:35,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:35,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:35,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:35,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,46239,1690124809597': 2023-07-23 15:07:35,261 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46239,1690124809597' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-23 15:07:35,261 INFO [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-23 15:07:35,262 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 15:07:35,262 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 15:07:35,262 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-23 15:07:35,262 INFO [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 15:07:35,263 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,263 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,263 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:07:35,263 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,263 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,264 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:07:35,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:07:35,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:07:35,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,264 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:07:35,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:07:35,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:07:35,264 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:35,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:07:35,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:07:35,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:07:35,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:07:35,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:07:35,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,265 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:35,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-23 15:07:35,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:07:35,268 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:35,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-23 15:07:35,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:35,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:35,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:35,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:07:35,270 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:35,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-23 15:07:35,271 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:35,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:35,271 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:35,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:35,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:35,278 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:07:35,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:07:35,278 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:35,278 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:07:35,278 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,278 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:07:35,278 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:07:35,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:07:35,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:07:35,278 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:07:35,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:07:35,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:07:35,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:07:35,279 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-23 15:07:35,279 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:07:35,278 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:35,278 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:07:35,279 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:35,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:07:35,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:07:35,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:07:35,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:07:35,279 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-23 15:07:35,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:07:35,281 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:07:35,281 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:07:35,281 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,281 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:07:35,281 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:07:35,281 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,281 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,282 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,307 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,326 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-23 15:07:35,326 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,327 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,327 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1690124855116Consolidate snapshot: snaptb0-testConsecutiveExports at 1690124855279 (+163 ms)Loading Region manifests for snaptb0-testConsecutiveExports at 1690124855281 (+2 ms)Writing data manifest for snaptb0-testConsecutiveExports at 1690124855285 (+4 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1690124855299 (+14 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1690124855326 (+27 ms) 2023-07-23 15:07:35,330 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-23 15:07:35,332 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 213 msec 2023-07-23 15:07:35,420 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 15:07:35,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-23 15:07:35,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 15:07:35,422 INFO [Listener at jenkins-hbase4.apache.org/33035] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/local-export-1690124855422 2023-07-23 15:07:35,422 INFO [Listener at jenkins-hbase4.apache.org/33035] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/local-export-1690124855422, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/local-export-1690124855422, srcFsUri=hdfs://localhost:45535, srcDir=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40 2023-07-23 15:07:35,444 DEBUG [Listener at jenkins-hbase4.apache.org/33035] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45535, inputRoot=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40 2023-07-23 15:07:35,444 DEBUG [Listener at jenkins-hbase4.apache.org/33035] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@186d4b98, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/local-export-1690124855422, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/local-export-1690124855422/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,444 INFO [Listener at jenkins-hbase4.apache.org/33035] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45535, inputRoot=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40, snapshotDir=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-23 15:07:35,452 INFO [Listener at jenkins-hbase4.apache.org/33035] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/local-export-1690124855422/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,465 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:35,466 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:35,466 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:35,467 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:35,467 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:35,467 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:35,468 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:35,541 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/hadoop-5076740809954051248.jar 2023-07-23 15:07:35,542 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:35,542 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:35,543 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:35,543 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:35,544 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:35,544 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:35,545 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-23 15:07:35,546 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-23 15:07:35,546 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-23 15:07:35,547 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-23 15:07:35,547 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-23 15:07:35,548 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-23 15:07:35,549 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-23 15:07:35,549 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-23 15:07:35,550 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-23 15:07:35,550 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-23 15:07:35,551 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 15:07:35,551 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 15:07:35,552 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 15:07:35,552 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 15:07:35,553 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 15:07:35,553 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 15:07:35,554 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 15:07:36,603 WARN [Listener at jenkins-hbase4.apache.org/33035] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-23 15:07:36,606 INFO [Listener at jenkins-hbase4.apache.org/33035] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-23 15:07:36,608 DEBUG [Listener at jenkins-hbase4.apache.org/33035] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-23 15:07:37,983 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 15:07:37,983 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 15:07:37,987 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690124817489_0002_000001 (auth:SIMPLE) 2023-07-23 15:07:38,453 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690124817489_0003_000001 (auth:SIMPLE) 2023-07-23 15:07:39,387 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-23 15:07:42,777 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690124817489_0003_000001 (auth:SIMPLE) 2023-07-23 15:07:45,013 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690124817489_0003_000001 (auth:SIMPLE) 2023-07-23 15:07:48,277 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690124817489_0003_000001 (auth:SIMPLE) 2023-07-23 15:07:49,792 INFO [Listener at jenkins-hbase4.apache.org/33035] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-23 15:07:49,793 INFO [Listener at jenkins-hbase4.apache.org/33035] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-23 15:07:49,796 INFO [Listener at jenkins-hbase4.apache.org/33035] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-23 15:07:49,796 INFO [Listener at jenkins-hbase4.apache.org/33035] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-23 15:07:49,797 INFO [Listener at jenkins-hbase4.apache.org/33035] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-23 15:07:49,797 DEBUG [Listener at jenkins-hbase4.apache.org/33035] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-979742745_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-23 15:07:49,799 DEBUG [Listener at jenkins-hbase4.apache.org/33035] snapshot.TestExportSnapshot(367): hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-23 15:07:49,799 DEBUG [Listener at jenkins-hbase4.apache.org/33035] snapshot.TestExportSnapshot(367): hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-23 15:07:49,799 DEBUG [Listener at jenkins-hbase4.apache.org/33035] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@26aa663b in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/local-export-1690124855422/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/local-export-1690124855422/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-23 15:07:49,800 DEBUG [Listener at jenkins-hbase4.apache.org/33035] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/local-export-1690124855422/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-23 15:07:49,800 DEBUG [Listener at jenkins-hbase4.apache.org/33035] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/local-export-1690124855422/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-23 15:07:49,801 INFO [Listener at jenkins-hbase4.apache.org/33035] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/local-export-1690124855422, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/local-export-1690124855422, srcFsUri=hdfs://localhost:45535, srcDir=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40 2023-07-23 15:07:49,822 DEBUG [Listener at jenkins-hbase4.apache.org/33035] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45535, inputRoot=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40 2023-07-23 15:07:49,822 DEBUG [Listener at jenkins-hbase4.apache.org/33035] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@3c8a8fcb, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/local-export-1690124855422, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/local-export-1690124855422/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-23 15:07:49,822 INFO [Listener at jenkins-hbase4.apache.org/33035] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45535, inputRoot=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40, snapshotDir=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-23 15:07:49,834 INFO [Listener at jenkins-hbase4.apache.org/33035] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/local-export-1690124855422/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-23 15:07:49,845 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:49,845 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:49,846 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:49,846 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:49,846 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:49,847 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:49,847 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:49,915 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/hadoop-4560358824691281898.jar 2023-07-23 15:07:49,916 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:49,916 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:49,917 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:49,917 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:49,917 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:49,917 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:49,918 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-23 15:07:49,918 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-23 15:07:49,919 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-23 15:07:49,919 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-23 15:07:49,919 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-23 15:07:49,920 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-23 15:07:49,920 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-23 15:07:49,920 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-23 15:07:49,921 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-23 15:07:49,921 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-23 15:07:49,922 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 15:07:49,922 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 15:07:49,922 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 15:07:49,923 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 15:07:49,923 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 15:07:49,923 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 15:07:49,923 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 15:07:50,293 WARN [Listener at jenkins-hbase4.apache.org/33035] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-23 15:07:50,295 INFO [Listener at jenkins-hbase4.apache.org/33035] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-23 15:07:50,297 DEBUG [Listener at jenkins-hbase4.apache.org/33035] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-23 15:07:54,464 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 15:07:54,464 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 15:07:54,467 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690124817489_0003_000001 (auth:SIMPLE) 2023-07-23 15:07:55,219 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690124817489_0004_000001 (auth:SIMPLE) 2023-07-23 15:07:59,684 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690124817489_0004_000001 (auth:SIMPLE) 2023-07-23 15:08:01,925 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690124817489_0004_000001 (auth:SIMPLE) 2023-07-23 15:08:04,566 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690124817489_0004_000001 (auth:SIMPLE) 2023-07-23 15:08:06,479 INFO [Listener at jenkins-hbase4.apache.org/33035] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-23 15:08:06,480 INFO [Listener at jenkins-hbase4.apache.org/33035] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-23 15:08:06,482 INFO [Listener at jenkins-hbase4.apache.org/33035] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-23 15:08:06,482 INFO [Listener at jenkins-hbase4.apache.org/33035] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-23 15:08:06,483 INFO [Listener at jenkins-hbase4.apache.org/33035] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-23 15:08:06,483 DEBUG [Listener at jenkins-hbase4.apache.org/33035] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-979742745_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-23 15:08:06,486 DEBUG [Listener at jenkins-hbase4.apache.org/33035] snapshot.TestExportSnapshot(367): hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-23 15:08:06,486 DEBUG [Listener at jenkins-hbase4.apache.org/33035] snapshot.TestExportSnapshot(367): hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-23 15:08:06,486 DEBUG [Listener at jenkins-hbase4.apache.org/33035] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@26aa663b in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/local-export-1690124855422/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/local-export-1690124855422/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-23 15:08:06,486 DEBUG [Listener at jenkins-hbase4.apache.org/33035] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/local-export-1690124855422/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-23 15:08:06,486 DEBUG [Listener at jenkins-hbase4.apache.org/33035] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/local-export-1690124855422/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-23 15:08:06,497 INFO [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-23 15:08:06,498 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-23 15:08:06,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-23 15:08:06,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-23 15:08:06,502 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690124886502"}]},"ts":"1690124886502"} 2023-07-23 15:08:06,503 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-23 15:08:06,505 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-23 15:08:06,506 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=377289208bd726e15fc847fa65b4f556, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=4ebcfbb462d5f4df9ca9e3f8987fa8f9, UNASSIGN}] 2023-07-23 15:08:06,508 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=4ebcfbb462d5f4df9ca9e3f8987fa8f9, UNASSIGN 2023-07-23 15:08:06,508 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=377289208bd726e15fc847fa65b4f556, UNASSIGN 2023-07-23 15:08:06,509 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=377289208bd726e15fc847fa65b4f556, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:06,509 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=4ebcfbb462d5f4df9ca9e3f8987fa8f9, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:06,509 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1690124854083.377289208bd726e15fc847fa65b4f556.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690124886509"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690124886509"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690124886509"}]},"ts":"1690124886509"} 2023-07-23 15:08:06,509 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1690124854083.4ebcfbb462d5f4df9ca9e3f8987fa8f9.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690124886509"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690124886509"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690124886509"}]},"ts":"1690124886509"} 2023-07-23 15:08:06,510 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure 377289208bd726e15fc847fa65b4f556, server=jenkins-hbase4.apache.org,46191,1690124809654}] 2023-07-23 15:08:06,511 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure 4ebcfbb462d5f4df9ca9e3f8987fa8f9, server=jenkins-hbase4.apache.org,46239,1690124809597}] 2023-07-23 15:08:06,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-23 15:08:06,666 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4ebcfbb462d5f4df9ca9e3f8987fa8f9 2023-07-23 15:08:06,666 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 377289208bd726e15fc847fa65b4f556 2023-07-23 15:08:06,666 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4ebcfbb462d5f4df9ca9e3f8987fa8f9, disabling compactions & flushes 2023-07-23 15:08:06,666 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 377289208bd726e15fc847fa65b4f556, disabling compactions & flushes 2023-07-23 15:08:06,666 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1690124854083.4ebcfbb462d5f4df9ca9e3f8987fa8f9. 2023-07-23 15:08:06,666 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1690124854083.377289208bd726e15fc847fa65b4f556. 2023-07-23 15:08:06,666 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1690124854083.4ebcfbb462d5f4df9ca9e3f8987fa8f9. 2023-07-23 15:08:06,666 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1690124854083.377289208bd726e15fc847fa65b4f556. 2023-07-23 15:08:06,666 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1690124854083.4ebcfbb462d5f4df9ca9e3f8987fa8f9. after waiting 0 ms 2023-07-23 15:08:06,667 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1690124854083.377289208bd726e15fc847fa65b4f556. after waiting 0 ms 2023-07-23 15:08:06,667 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1690124854083.377289208bd726e15fc847fa65b4f556. 2023-07-23 15:08:06,667 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1690124854083.4ebcfbb462d5f4df9ca9e3f8987fa8f9. 2023-07-23 15:08:06,681 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testConsecutiveExports/377289208bd726e15fc847fa65b4f556/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 15:08:06,682 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 15:08:06,683 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1690124854083.377289208bd726e15fc847fa65b4f556. 2023-07-23 15:08:06,683 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testConsecutiveExports/4ebcfbb462d5f4df9ca9e3f8987fa8f9/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 15:08:06,683 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 377289208bd726e15fc847fa65b4f556: 2023-07-23 15:08:06,684 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 15:08:06,685 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1690124854083.4ebcfbb462d5f4df9ca9e3f8987fa8f9. 2023-07-23 15:08:06,685 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4ebcfbb462d5f4df9ca9e3f8987fa8f9: 2023-07-23 15:08:06,686 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 377289208bd726e15fc847fa65b4f556 2023-07-23 15:08:06,687 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=377289208bd726e15fc847fa65b4f556, regionState=CLOSED 2023-07-23 15:08:06,687 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1690124854083.377289208bd726e15fc847fa65b4f556.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690124886686"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690124886686"}]},"ts":"1690124886686"} 2023-07-23 15:08:06,687 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4ebcfbb462d5f4df9ca9e3f8987fa8f9 2023-07-23 15:08:06,688 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=4ebcfbb462d5f4df9ca9e3f8987fa8f9, regionState=CLOSED 2023-07-23 15:08:06,688 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1690124854083.4ebcfbb462d5f4df9ca9e3f8987fa8f9.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690124886688"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690124886688"}]},"ts":"1690124886688"} 2023-07-23 15:08:06,691 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=52 2023-07-23 15:08:06,691 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure 377289208bd726e15fc847fa65b4f556, server=jenkins-hbase4.apache.org,46191,1690124809654 in 178 msec 2023-07-23 15:08:06,693 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=53 2023-07-23 15:08:06,693 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure 4ebcfbb462d5f4df9ca9e3f8987fa8f9, server=jenkins-hbase4.apache.org,46239,1690124809597 in 179 msec 2023-07-23 15:08:06,693 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=377289208bd726e15fc847fa65b4f556, UNASSIGN in 185 msec 2023-07-23 15:08:06,695 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-07-23 15:08:06,695 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=4ebcfbb462d5f4df9ca9e3f8987fa8f9, UNASSIGN in 187 msec 2023-07-23 15:08:06,695 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690124886695"}]},"ts":"1690124886695"} 2023-07-23 15:08:06,697 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-23 15:08:06,698 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-23 15:08:06,700 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 201 msec 2023-07-23 15:08:06,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-23 15:08:06,804 INFO [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-23 15:08:06,805 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-23 15:08:06,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-23 15:08:06,809 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-23 15:08:06,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-23 15:08:06,810 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-23 15:08:06,813 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34279] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-23 15:08:06,816 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-23 15:08:06,816 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-23 15:08:06,816 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-23 15:08:06,816 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-23 15:08:06,817 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testConsecutiveExports/377289208bd726e15fc847fa65b4f556 2023-07-23 15:08:06,817 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testConsecutiveExports/4ebcfbb462d5f4df9ca9e3f8987fa8f9 2023-07-23 15:08:06,817 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-23 15:08:06,817 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-23 15:08:06,817 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-23 15:08:06,817 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-23 15:08:06,818 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-23 15:08:06,818 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-23 15:08:06,818 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:08:06,818 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:08:06,818 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-23 15:08:06,818 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-23 15:08:06,818 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:08:06,818 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:08:06,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-23 15:08:06,819 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testConsecutiveExports/377289208bd726e15fc847fa65b4f556/cf, FileablePath, hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testConsecutiveExports/377289208bd726e15fc847fa65b4f556/recovered.edits] 2023-07-23 15:08:06,820 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testConsecutiveExports/4ebcfbb462d5f4df9ca9e3f8987fa8f9/cf, FileablePath, hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testConsecutiveExports/4ebcfbb462d5f4df9ca9e3f8987fa8f9/recovered.edits] 2023-07-23 15:08:06,824 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testConsecutiveExports/377289208bd726e15fc847fa65b4f556/cf/2d6c27a9a442419b97349063d813bef5 to hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/archive/data/default/testtb-testConsecutiveExports/377289208bd726e15fc847fa65b4f556/cf/2d6c27a9a442419b97349063d813bef5 2023-07-23 15:08:06,824 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testConsecutiveExports/4ebcfbb462d5f4df9ca9e3f8987fa8f9/cf/5f20a4ac613d4a698f906038201a7777 to hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/archive/data/default/testtb-testConsecutiveExports/4ebcfbb462d5f4df9ca9e3f8987fa8f9/cf/5f20a4ac613d4a698f906038201a7777 2023-07-23 15:08:06,827 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testConsecutiveExports/377289208bd726e15fc847fa65b4f556/recovered.edits/9.seqid to hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/archive/data/default/testtb-testConsecutiveExports/377289208bd726e15fc847fa65b4f556/recovered.edits/9.seqid 2023-07-23 15:08:06,827 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testConsecutiveExports/4ebcfbb462d5f4df9ca9e3f8987fa8f9/recovered.edits/9.seqid to hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/archive/data/default/testtb-testConsecutiveExports/4ebcfbb462d5f4df9ca9e3f8987fa8f9/recovered.edits/9.seqid 2023-07-23 15:08:06,828 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testConsecutiveExports/377289208bd726e15fc847fa65b4f556 2023-07-23 15:08:06,828 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testConsecutiveExports/4ebcfbb462d5f4df9ca9e3f8987fa8f9 2023-07-23 15:08:06,828 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-23 15:08:06,830 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-23 15:08:06,833 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-23 15:08:06,835 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-23 15:08:06,836 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-23 15:08:06,836 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-23 15:08:06,836 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1690124854083.377289208bd726e15fc847fa65b4f556.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690124886836"}]},"ts":"9223372036854775807"} 2023-07-23 15:08:06,836 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1690124854083.4ebcfbb462d5f4df9ca9e3f8987fa8f9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690124886836"}]},"ts":"9223372036854775807"} 2023-07-23 15:08:06,838 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-23 15:08:06,838 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 377289208bd726e15fc847fa65b4f556, NAME => 'testtb-testConsecutiveExports,,1690124854083.377289208bd726e15fc847fa65b4f556.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 4ebcfbb462d5f4df9ca9e3f8987fa8f9, NAME => 'testtb-testConsecutiveExports,1,1690124854083.4ebcfbb462d5f4df9ca9e3f8987fa8f9.', STARTKEY => '1', ENDKEY => ''}] 2023-07-23 15:08:06,838 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-23 15:08:06,838 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690124886838"}]},"ts":"9223372036854775807"} 2023-07-23 15:08:06,840 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-23 15:08:06,842 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-23 15:08:06,844 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 37 msec 2023-07-23 15:08:06,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-23 15:08:06,920 INFO [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-23 15:08:06,930 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-23 15:08:06,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-23 15:08:06,933 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-23 15:08:06,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-23 15:08:06,961 INFO [Listener at jenkins-hbase4.apache.org/33035] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=748 (was 765), OpenFileDescriptor=898 (was 917), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=277 (was 275) - SystemLoadAverage LEAK? -, ProcessCount=179 (was 179), AvailableMemoryMB=5976 (was 6278) 2023-07-23 15:08:06,961 WARN [Listener at jenkins-hbase4.apache.org/33035] hbase.ResourceChecker(130): Thread=748 is superior to 500 2023-07-23 15:08:06,981 INFO [Listener at jenkins-hbase4.apache.org/33035] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=748, OpenFileDescriptor=898, MaxFileDescriptor=60000, SystemLoadAverage=277, ProcessCount=179, AvailableMemoryMB=5975 2023-07-23 15:08:06,981 WARN [Listener at jenkins-hbase4.apache.org/33035] hbase.ResourceChecker(130): Thread=748 is superior to 500 2023-07-23 15:08:06,983 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-23 15:08:06,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:06,986 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-23 15:08:06,986 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-23 15:08:06,987 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-23 15:08:06,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-23 15:08:06,990 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0a4a68a8fcbff03045cb8a10cb16e91f 2023-07-23 15:08:06,990 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/bbd1a26a126212ba5ef5066fefc2c4f6 2023-07-23 15:08:06,990 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0a4a68a8fcbff03045cb8a10cb16e91f empty. 2023-07-23 15:08:06,990 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/bbd1a26a126212ba5ef5066fefc2c4f6 empty. 2023-07-23 15:08:06,991 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/bbd1a26a126212ba5ef5066fefc2c4f6 2023-07-23 15:08:06,991 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0a4a68a8fcbff03045cb8a10cb16e91f 2023-07-23 15:08:06,991 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-23 15:08:07,005 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-23 15:08:07,007 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0a4a68a8fcbff03045cb8a10cb16e91f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1690124886982.0a4a68a8fcbff03045cb8a10cb16e91f.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp 2023-07-23 15:08:07,007 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => bbd1a26a126212ba5ef5066fefc2c4f6, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1690124886982.bbd1a26a126212ba5ef5066fefc2c4f6.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp 2023-07-23 15:08:07,032 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1690124886982.bbd1a26a126212ba5ef5066fefc2c4f6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:08:07,032 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing bbd1a26a126212ba5ef5066fefc2c4f6, disabling compactions & flushes 2023-07-23 15:08:07,032 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1690124886982.bbd1a26a126212ba5ef5066fefc2c4f6. 2023-07-23 15:08:07,032 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690124886982.bbd1a26a126212ba5ef5066fefc2c4f6. 2023-07-23 15:08:07,032 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690124886982.bbd1a26a126212ba5ef5066fefc2c4f6. after waiting 0 ms 2023-07-23 15:08:07,033 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1690124886982.bbd1a26a126212ba5ef5066fefc2c4f6. 2023-07-23 15:08:07,033 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1690124886982.bbd1a26a126212ba5ef5066fefc2c4f6. 2023-07-23 15:08:07,033 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1690124886982.0a4a68a8fcbff03045cb8a10cb16e91f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:08:07,034 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for bbd1a26a126212ba5ef5066fefc2c4f6: 2023-07-23 15:08:07,034 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 0a4a68a8fcbff03045cb8a10cb16e91f, disabling compactions & flushes 2023-07-23 15:08:07,034 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1690124886982.0a4a68a8fcbff03045cb8a10cb16e91f. 2023-07-23 15:08:07,034 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690124886982.0a4a68a8fcbff03045cb8a10cb16e91f. 2023-07-23 15:08:07,034 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690124886982.0a4a68a8fcbff03045cb8a10cb16e91f. after waiting 0 ms 2023-07-23 15:08:07,034 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1690124886982.0a4a68a8fcbff03045cb8a10cb16e91f. 2023-07-23 15:08:07,034 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1690124886982.0a4a68a8fcbff03045cb8a10cb16e91f. 2023-07-23 15:08:07,034 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 0a4a68a8fcbff03045cb8a10cb16e91f: 2023-07-23 15:08:07,037 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-23 15:08:07,038 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690124886982.bbd1a26a126212ba5ef5066fefc2c4f6.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690124887038"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690124887038"}]},"ts":"1690124887038"} 2023-07-23 15:08:07,038 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690124886982.0a4a68a8fcbff03045cb8a10cb16e91f.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690124887038"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690124887038"}]},"ts":"1690124887038"} 2023-07-23 15:08:07,045 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-23 15:08:07,046 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-23 15:08:07,046 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690124887046"}]},"ts":"1690124887046"} 2023-07-23 15:08:07,047 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-23 15:08:07,051 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-23 15:08:07,053 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-23 15:08:07,053 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-23 15:08:07,053 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-23 15:08:07,053 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-23 15:08:07,053 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0a4a68a8fcbff03045cb8a10cb16e91f, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=bbd1a26a126212ba5ef5066fefc2c4f6, ASSIGN}] 2023-07-23 15:08:07,056 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=bbd1a26a126212ba5ef5066fefc2c4f6, ASSIGN 2023-07-23 15:08:07,056 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0a4a68a8fcbff03045cb8a10cb16e91f, ASSIGN 2023-07-23 15:08:07,057 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0a4a68a8fcbff03045cb8a10cb16e91f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46191,1690124809654; forceNewPlan=false, retain=false 2023-07-23 15:08:07,057 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=bbd1a26a126212ba5ef5066fefc2c4f6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34279,1690124809505; forceNewPlan=false, retain=false 2023-07-23 15:08:07,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-23 15:08:07,207 INFO [jenkins-hbase4:38379] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-23 15:08:07,210 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=0a4a68a8fcbff03045cb8a10cb16e91f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:07,210 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=bbd1a26a126212ba5ef5066fefc2c4f6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:07,210 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690124886982.0a4a68a8fcbff03045cb8a10cb16e91f.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690124887210"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690124887210"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690124887210"}]},"ts":"1690124887210"} 2023-07-23 15:08:07,210 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690124886982.bbd1a26a126212ba5ef5066fefc2c4f6.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690124887210"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690124887210"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690124887210"}]},"ts":"1690124887210"} 2023-07-23 15:08:07,213 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure bbd1a26a126212ba5ef5066fefc2c4f6, server=jenkins-hbase4.apache.org,34279,1690124809505}] 2023-07-23 15:08:07,215 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure 0a4a68a8fcbff03045cb8a10cb16e91f, server=jenkins-hbase4.apache.org,46191,1690124809654}] 2023-07-23 15:08:07,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-23 15:08:07,373 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1690124886982.bbd1a26a126212ba5ef5066fefc2c4f6. 2023-07-23 15:08:07,373 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1690124886982.0a4a68a8fcbff03045cb8a10cb16e91f. 2023-07-23 15:08:07,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bbd1a26a126212ba5ef5066fefc2c4f6, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1690124886982.bbd1a26a126212ba5ef5066fefc2c4f6.', STARTKEY => '1', ENDKEY => ''} 2023-07-23 15:08:07,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0a4a68a8fcbff03045cb8a10cb16e91f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1690124886982.0a4a68a8fcbff03045cb8a10cb16e91f.', STARTKEY => '', ENDKEY => '1'} 2023-07-23 15:08:07,374 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1690124886982.bbd1a26a126212ba5ef5066fefc2c4f6. service=AccessControlService 2023-07-23 15:08:07,374 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1690124886982.0a4a68a8fcbff03045cb8a10cb16e91f. service=AccessControlService 2023-07-23 15:08:07,374 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 15:08:07,374 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 15:08:07,374 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion bbd1a26a126212ba5ef5066fefc2c4f6 2023-07-23 15:08:07,374 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 0a4a68a8fcbff03045cb8a10cb16e91f 2023-07-23 15:08:07,374 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1690124886982.bbd1a26a126212ba5ef5066fefc2c4f6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:08:07,374 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1690124886982.0a4a68a8fcbff03045cb8a10cb16e91f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:08:07,374 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for bbd1a26a126212ba5ef5066fefc2c4f6 2023-07-23 15:08:07,374 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0a4a68a8fcbff03045cb8a10cb16e91f 2023-07-23 15:08:07,374 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for bbd1a26a126212ba5ef5066fefc2c4f6 2023-07-23 15:08:07,374 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0a4a68a8fcbff03045cb8a10cb16e91f 2023-07-23 15:08:07,376 INFO [StoreOpener-bbd1a26a126212ba5ef5066fefc2c4f6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region bbd1a26a126212ba5ef5066fefc2c4f6 2023-07-23 15:08:07,376 INFO [StoreOpener-0a4a68a8fcbff03045cb8a10cb16e91f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0a4a68a8fcbff03045cb8a10cb16e91f 2023-07-23 15:08:07,377 DEBUG [StoreOpener-bbd1a26a126212ba5ef5066fefc2c4f6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithMergeRegion/bbd1a26a126212ba5ef5066fefc2c4f6/cf 2023-07-23 15:08:07,378 DEBUG [StoreOpener-bbd1a26a126212ba5ef5066fefc2c4f6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithMergeRegion/bbd1a26a126212ba5ef5066fefc2c4f6/cf 2023-07-23 15:08:07,378 DEBUG [StoreOpener-0a4a68a8fcbff03045cb8a10cb16e91f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithMergeRegion/0a4a68a8fcbff03045cb8a10cb16e91f/cf 2023-07-23 15:08:07,378 DEBUG [StoreOpener-0a4a68a8fcbff03045cb8a10cb16e91f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithMergeRegion/0a4a68a8fcbff03045cb8a10cb16e91f/cf 2023-07-23 15:08:07,379 INFO [StoreOpener-bbd1a26a126212ba5ef5066fefc2c4f6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bbd1a26a126212ba5ef5066fefc2c4f6 columnFamilyName cf 2023-07-23 15:08:07,379 INFO [StoreOpener-0a4a68a8fcbff03045cb8a10cb16e91f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0a4a68a8fcbff03045cb8a10cb16e91f columnFamilyName cf 2023-07-23 15:08:07,382 INFO [StoreOpener-bbd1a26a126212ba5ef5066fefc2c4f6-1] regionserver.HStore(310): Store=bbd1a26a126212ba5ef5066fefc2c4f6/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 15:08:07,382 INFO [StoreOpener-0a4a68a8fcbff03045cb8a10cb16e91f-1] regionserver.HStore(310): Store=0a4a68a8fcbff03045cb8a10cb16e91f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 15:08:07,383 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithMergeRegion/bbd1a26a126212ba5ef5066fefc2c4f6 2023-07-23 15:08:07,383 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithMergeRegion/0a4a68a8fcbff03045cb8a10cb16e91f 2023-07-23 15:08:07,383 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithMergeRegion/bbd1a26a126212ba5ef5066fefc2c4f6 2023-07-23 15:08:07,384 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithMergeRegion/0a4a68a8fcbff03045cb8a10cb16e91f 2023-07-23 15:08:07,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for bbd1a26a126212ba5ef5066fefc2c4f6 2023-07-23 15:08:07,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0a4a68a8fcbff03045cb8a10cb16e91f 2023-07-23 15:08:07,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithMergeRegion/0a4a68a8fcbff03045cb8a10cb16e91f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 15:08:07,390 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0a4a68a8fcbff03045cb8a10cb16e91f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75382834, jitterRate=0.12329176068305969}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 15:08:07,390 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0a4a68a8fcbff03045cb8a10cb16e91f: 2023-07-23 15:08:07,390 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithMergeRegion/bbd1a26a126212ba5ef5066fefc2c4f6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 15:08:07,391 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened bbd1a26a126212ba5ef5066fefc2c4f6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60587809, jitterRate=-0.09717129170894623}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 15:08:07,391 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for bbd1a26a126212ba5ef5066fefc2c4f6: 2023-07-23 15:08:07,392 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1690124886982.0a4a68a8fcbff03045cb8a10cb16e91f., pid=61, masterSystemTime=1690124887368 2023-07-23 15:08:07,392 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1690124886982.bbd1a26a126212ba5ef5066fefc2c4f6., pid=60, masterSystemTime=1690124887367 2023-07-23 15:08:07,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1690124886982.0a4a68a8fcbff03045cb8a10cb16e91f. 2023-07-23 15:08:07,395 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1690124886982.0a4a68a8fcbff03045cb8a10cb16e91f. 2023-07-23 15:08:07,395 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=0a4a68a8fcbff03045cb8a10cb16e91f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:07,395 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1690124886982.bbd1a26a126212ba5ef5066fefc2c4f6. 2023-07-23 15:08:07,395 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1690124886982.bbd1a26a126212ba5ef5066fefc2c4f6. 2023-07-23 15:08:07,395 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690124886982.0a4a68a8fcbff03045cb8a10cb16e91f.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690124887395"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690124887395"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690124887395"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690124887395"}]},"ts":"1690124887395"} 2023-07-23 15:08:07,396 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=bbd1a26a126212ba5ef5066fefc2c4f6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:07,396 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690124886982.bbd1a26a126212ba5ef5066fefc2c4f6.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690124887396"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690124887396"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690124887396"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690124887396"}]},"ts":"1690124887396"} 2023-07-23 15:08:07,400 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=58 2023-07-23 15:08:07,400 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure 0a4a68a8fcbff03045cb8a10cb16e91f, server=jenkins-hbase4.apache.org,46191,1690124809654 in 183 msec 2023-07-23 15:08:07,401 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-07-23 15:08:07,401 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure bbd1a26a126212ba5ef5066fefc2c4f6, server=jenkins-hbase4.apache.org,34279,1690124809505 in 186 msec 2023-07-23 15:08:07,401 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0a4a68a8fcbff03045cb8a10cb16e91f, ASSIGN in 347 msec 2023-07-23 15:08:07,403 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=59, resume processing ppid=57 2023-07-23 15:08:07,403 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=bbd1a26a126212ba5ef5066fefc2c4f6, ASSIGN in 348 msec 2023-07-23 15:08:07,404 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-23 15:08:07,404 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690124887404"}]},"ts":"1690124887404"} 2023-07-23 15:08:07,405 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-23 15:08:07,407 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-23 15:08:07,408 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-23 15:08:07,409 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34279] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-23 15:08:07,411 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:08:07,411 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:08:07,411 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:08:07,411 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:08:07,412 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 15:08:07,412 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 15:08:07,412 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 15:08:07,412 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 15:08:07,414 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 429 msec 2023-07-23 15:08:07,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-23 15:08:07,591 INFO [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-23 15:08:07,592 DEBUG [Listener at jenkins-hbase4.apache.org/33035] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithMergeRegion get assigned. Timeout = 60000ms 2023-07-23 15:08:07,592 INFO [Listener at jenkins-hbase4.apache.org/33035] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 15:08:07,595 INFO [Listener at jenkins-hbase4.apache.org/33035] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned to meta. Checking AM states. 2023-07-23 15:08:07,595 INFO [Listener at jenkins-hbase4.apache.org/33035] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 15:08:07,595 INFO [Listener at jenkins-hbase4.apache.org/33035] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned. 2023-07-23 15:08:07,598 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-23 15:08:07,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690124887598 (current time:1690124887598). 2023-07-23 15:08:07,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 15:08:07,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] zookeeper.ReadOnlyZKClient(139): Connect 0x70fcdc9a to 127.0.0.1:51019 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 15:08:07,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@53b41e35, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 15:08:07,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:08:07,609 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43736, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:08:07,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x70fcdc9a to 127.0.0.1:51019 2023-07-23 15:08:07,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 15:08:07,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] zookeeper.ReadOnlyZKClient(139): Connect 0x6c932723 to 127.0.0.1:51019 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 15:08:07,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7a9d2e27, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 15:08:07,617 DEBUG [hconnection-0x92bc2f7-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:08:07,619 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43740, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:08:07,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6c932723 to 127.0.0.1:51019 2023-07-23 15:08:07,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 15:08:07,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-23 15:08:07,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 15:08:07,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-23 15:08:07,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-23 15:08:07,627 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-23 15:08:07,629 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1690125487629 2023-07-23 15:08:07,629 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-23 15:08:07,631 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 15:08:07,631 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 15:08:07,631 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-23 15:08:07,632 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-23 15:08:07,633 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 6 msec 2023-07-23 15:08:07,634 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-23 15:08:07,634 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1690125487634 2023-07-23 15:08:07,646 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,646 INFO [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-23 15:08:07,646 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:08:07,647 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-23 15:08:07,647 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-23 15:08:07,648 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,648 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,650 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:07,650 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:07,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:07,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:07,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:07,650 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:07,650 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:07,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:07,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:07,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:07,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,651 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:07,651 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:07,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,651 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,651 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:07,651 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 15:08:07,651 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,651 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-23 15:08:07,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,652 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-23 15:08:07,652 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,652 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-23 15:08:07,652 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:08:07,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-23 15:08:07,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-23 15:08:07,653 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-23 15:08:07,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,654 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-23 15:08:07,654 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-23 15:08:07,654 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-23 15:08:07,654 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46191,1690124809654' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-23 15:08:07,654 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,654 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-23 15:08:07,654 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,654 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:08:07,654 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-23 15:08:07,655 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:08:07,655 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-23 15:08:07,656 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-23 15:08:07,656 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-23 15:08:07,656 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-23 15:08:07,656 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34279,1690124809505' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-23 15:08:07,656 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46239,1690124809597' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-23 15:08:07,658 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,658 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:07,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:07,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:08:07,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:08:07,659 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:07,659 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,659 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:08:07,659 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,659 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,659 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,660 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:08:07,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:08:07,660 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,660 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:08:07,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:08:07,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:07,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:07,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:07,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:08:07,661 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46191,1690124809654' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-23 15:08:07,661 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@31773e3[Count = 1] remaining members to acquire global barrier 2023-07-23 15:08:07,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:07,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:08:07,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:08:07,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:08:07,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:08:07,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:07,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:07,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:07,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:08:07,663 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34279,1690124809505' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-23 15:08:07,663 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@31773e3[Count = 0] remaining members to acquire global barrier 2023-07-23 15:08:07,663 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-23 15:08:07,663 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,665 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,665 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,665 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,665 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-23 15:08:07,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,665 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-23 15:08:07,666 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-23 15:08:07,665 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-23 15:08:07,666 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,46239,1690124809597' in zk 2023-07-23 15:08:07,666 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:07,666 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 15:08:07,666 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 15:08:07,666 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690124886982.0a4a68a8fcbff03045cb8a10cb16e91f. 2023-07-23 15:08:07,666 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 15:08:07,666 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690124886982.0a4a68a8fcbff03045cb8a10cb16e91f. started... 2023-07-23 15:08:07,666 DEBUG [rs(jenkins-hbase4.apache.org,34279,1690124809505)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690124886982.bbd1a26a126212ba5ef5066fefc2c4f6. 2023-07-23 15:08:07,666 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 15:08:07,666 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:07,667 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 15:08:07,667 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0a4a68a8fcbff03045cb8a10cb16e91f: 2023-07-23 15:08:07,666 DEBUG [rs(jenkins-hbase4.apache.org,34279,1690124809505)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690124886982.bbd1a26a126212ba5ef5066fefc2c4f6. started... 2023-07-23 15:08:07,667 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1690124886982.0a4a68a8fcbff03045cb8a10cb16e91f.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,668 DEBUG [rs(jenkins-hbase4.apache.org,34279,1690124809505)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for bbd1a26a126212ba5ef5066fefc2c4f6: 2023-07-23 15:08:07,668 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 15:08:07,668 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 15:08:07,668 DEBUG [rs(jenkins-hbase4.apache.org,34279,1690124809505)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1690124886982.bbd1a26a126212ba5ef5066fefc2c4f6.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,668 DEBUG [rs(jenkins-hbase4.apache.org,34279,1690124809505)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 15:08:07,668 DEBUG [rs(jenkins-hbase4.apache.org,34279,1690124809505)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 15:08:07,674 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-23 15:08:07,674 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:08:07,674 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-23 15:08:07,708 DEBUG [rs(jenkins-hbase4.apache.org,34279,1690124809505)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690124886982.bbd1a26a126212ba5ef5066fefc2c4f6. completed. 2023-07-23 15:08:07,708 DEBUG [rs(jenkins-hbase4.apache.org,34279,1690124809505)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690124886982.bbd1a26a126212ba5ef5066fefc2c4f6. 2023-07-23 15:08:07,709 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 15:08:07,709 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 15:08:07,709 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:07,709 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-23 15:08:07,709 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,34279,1690124809505' in zk 2023-07-23 15:08:07,710 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-23 15:08:07,710 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:07,710 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:08:07,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:07,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:08:07,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:08:07,711 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-23 15:08:07,713 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690124886982.0a4a68a8fcbff03045cb8a10cb16e91f. completed. 2023-07-23 15:08:07,713 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690124886982.0a4a68a8fcbff03045cb8a10cb16e91f. 2023-07-23 15:08:07,713 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 15:08:07,713 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 15:08:07,713 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:07,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:08:07,713 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-23 15:08:07,713 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,46191,1690124809654' in zk 2023-07-23 15:08:07,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:08:07,714 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-23 15:08:07,714 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:07,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,714 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:08:07,715 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-23 15:08:07,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:07,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:07,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:07,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:08:07,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:07,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:07,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:07,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,34279,1690124809505': 2023-07-23 15:08:07,718 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34279,1690124809505' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-23 15:08:07,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:07,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:08:07,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:08:07,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:08:07,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:08:07,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:07,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:07,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:07,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:08:07,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:07,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:07,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:07,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,46191,1690124809654': 2023-07-23 15:08:07,721 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46191,1690124809654' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-23 15:08:07,721 INFO [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-23 15:08:07,721 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 15:08:07,721 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 15:08:07,721 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,721 INFO [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 15:08:07,724 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,724 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,724 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,724 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,724 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,724 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,724 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:08:07,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:08:07,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,724 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:07,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,724 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:07,724 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:07,725 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:07,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:08:07,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:07,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:07,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:07,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:07,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:07,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:07,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,725 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:07,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:08:07,726 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:07,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:07,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:07,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:07,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:08:07,728 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:07,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,728 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:07,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:07,729 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:07,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:07,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:07,731 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 15:08:07,732 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:07,732 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:07,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-23 15:08:07,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:07,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-23 15:08:07,732 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:07,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:07,732 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:07,732 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:07,732 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 15:08:07,732 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:07,732 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,732 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:08:07,732 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,732 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:07,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:07,732 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:07,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:07,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:07,732 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:07,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:07,734 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:07,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:07,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:07,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:07,734 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,734 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:07,734 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,734 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:07,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:07,734 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:07,735 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:07,735 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,735 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,755 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,789 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-23 15:08:07,789 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,790 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,790 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1690124887629Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690124887732 (+103 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690124887734 (+2 ms)Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690124887737 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690124887750 (+13 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1690124887789 (+39 ms) 2023-07-23 15:08:07,793 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-23 15:08:07,794 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 163 msec 2023-07-23 15:08:07,932 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 15:08:07,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-23 15:08:07,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 15:08:07,944 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46191] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1690124886982.0a4a68a8fcbff03045cb8a10cb16e91f. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 15:08:07,945 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34279] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1690124886982.bbd1a26a126212ba5ef5066fefc2c4f6. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 15:08:07,949 DEBUG [Listener at jenkins-hbase4.apache.org/33035] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,950 DEBUG [Listener at jenkins-hbase4.apache.org/33035] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1690124886982.0a4a68a8fcbff03045cb8a10cb16e91f. 2023-07-23 15:08:07,950 INFO [Listener at jenkins-hbase4.apache.org/33035] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 15:08:07,964 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-23 15:08:07,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690124887964 (current time:1690124887964). 2023-07-23 15:08:07,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 15:08:07,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] zookeeper.ReadOnlyZKClient(139): Connect 0x71fea19e to 127.0.0.1:51019 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 15:08:07,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1db532cc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 15:08:07,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:08:07,976 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43742, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:08:07,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x71fea19e to 127.0.0.1:51019 2023-07-23 15:08:07,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 15:08:07,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] zookeeper.ReadOnlyZKClient(139): Connect 0x714239f2 to 127.0.0.1:51019 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 15:08:07,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@75349415, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 15:08:07,986 DEBUG [hconnection-0x4123fb2d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:08:07,989 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43754, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:08:07,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x714239f2 to 127.0.0.1:51019 2023-07-23 15:08:07,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 15:08:07,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-23 15:08:07,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 15:08:07,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-23 15:08:07,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-23 15:08:07,997 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-23 15:08:07,998 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1690125487998 2023-07-23 15:08:07,998 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-23 15:08:07,999 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 15:08:07,999 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 15:08:07,999 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-23 15:08:08,000 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-23 15:08:08,002 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-07-23 15:08:08,003 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-23 15:08:08,004 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1690125488004 2023-07-23 15:08:08,013 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,013 INFO [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-23 15:08:08,013 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:08:08,014 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-23 15:08:08,014 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-23 15:08:08,015 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,015 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,016 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:08,016 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:08,016 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:08,016 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:08,016 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:08,016 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:08,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:08,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:08,017 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:08,017 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:08,016 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:08,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:08,017 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:08,017 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 15:08:08,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,018 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-23 15:08:08,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,018 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-23 15:08:08,018 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,019 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-23 15:08:08,019 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:08:08,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,019 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,020 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-23 15:08:08,020 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-23 15:08:08,020 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34279,1690124809505' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-23 15:08:08,020 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-23 15:08:08,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,021 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-23 15:08:08,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-23 15:08:08,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,021 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-23 15:08:08,021 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,021 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-23 15:08:08,021 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:08:08,022 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:08,022 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:08,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:08:08,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:08:08,022 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,022 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:08:08,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:08:08,024 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-23 15:08:08,024 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-23 15:08:08,024 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,024 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46239,1690124809597' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-23 15:08:08,024 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-23 15:08:08,024 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:08:08,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:08:08,025 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-23 15:08:08,025 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-23 15:08:08,025 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46191,1690124809654' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-23 15:08:08,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,027 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:08,028 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:08,028 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:08,028 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:08:08,028 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:08:08,028 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,028 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:08:08,028 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34279,1690124809505' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-23 15:08:08,028 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@55df0554[Count = 1] remaining members to acquire global barrier 2023-07-23 15:08:08,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:08,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:08:08,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:08:08,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:08:08,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:08:08,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:08,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:08,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:08,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:08:08,030 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46191,1690124809654' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-23 15:08:08,030 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@55df0554[Count = 0] remaining members to acquire global barrier 2023-07-23 15:08:08,030 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-23 15:08:08,030 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,031 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,031 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,031 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,031 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-23 15:08:08,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,032 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-23 15:08:08,032 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 15:08:08,032 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 15:08:08,032 DEBUG [rs(jenkins-hbase4.apache.org,34279,1690124809505)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690124886982.bbd1a26a126212ba5ef5066fefc2c4f6. 2023-07-23 15:08:08,032 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 15:08:08,032 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 15:08:08,032 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690124886982.0a4a68a8fcbff03045cb8a10cb16e91f. 2023-07-23 15:08:08,032 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-23 15:08:08,032 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690124886982.0a4a68a8fcbff03045cb8a10cb16e91f. started... 2023-07-23 15:08:08,032 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-23 15:08:08,032 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,46239,1690124809597' in zk 2023-07-23 15:08:08,032 DEBUG [rs(jenkins-hbase4.apache.org,34279,1690124809505)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690124886982.bbd1a26a126212ba5ef5066fefc2c4f6. started... 2023-07-23 15:08:08,032 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:08,032 INFO [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0a4a68a8fcbff03045cb8a10cb16e91f 1/1 column families, dataSize=467 B heapSize=1.23 KB 2023-07-23 15:08:08,032 INFO [rs(jenkins-hbase4.apache.org,34279,1690124809505)-snapshot-pool-0] regionserver.HRegion(2745): Flushing bbd1a26a126212ba5ef5066fefc2c4f6 1/1 column families, dataSize=2.80 KB heapSize=6.30 KB 2023-07-23 15:08:08,032 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:08,033 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 15:08:08,033 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-23 15:08:08,034 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:08:08,034 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-23 15:08:08,046 INFO [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=467 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithMergeRegion/0a4a68a8fcbff03045cb8a10cb16e91f/.tmp/cf/6efa3c6054004533a0470ac91fac3540 2023-07-23 15:08:08,046 INFO [rs(jenkins-hbase4.apache.org,34279,1690124809505)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.80 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithMergeRegion/bbd1a26a126212ba5ef5066fefc2c4f6/.tmp/cf/bf0431f3f08f4cbf80ace843298b5ec3 2023-07-23 15:08:08,053 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithMergeRegion/0a4a68a8fcbff03045cb8a10cb16e91f/.tmp/cf/6efa3c6054004533a0470ac91fac3540 as hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithMergeRegion/0a4a68a8fcbff03045cb8a10cb16e91f/cf/6efa3c6054004533a0470ac91fac3540 2023-07-23 15:08:08,053 DEBUG [rs(jenkins-hbase4.apache.org,34279,1690124809505)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithMergeRegion/bbd1a26a126212ba5ef5066fefc2c4f6/.tmp/cf/bf0431f3f08f4cbf80ace843298b5ec3 as hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithMergeRegion/bbd1a26a126212ba5ef5066fefc2c4f6/cf/bf0431f3f08f4cbf80ace843298b5ec3 2023-07-23 15:08:08,058 INFO [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithMergeRegion/0a4a68a8fcbff03045cb8a10cb16e91f/cf/6efa3c6054004533a0470ac91fac3540, entries=7, sequenceid=6, filesize=5.3 K 2023-07-23 15:08:08,058 INFO [rs(jenkins-hbase4.apache.org,34279,1690124809505)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithMergeRegion/bbd1a26a126212ba5ef5066fefc2c4f6/cf/bf0431f3f08f4cbf80ace843298b5ec3, entries=43, sequenceid=6, filesize=7.7 K 2023-07-23 15:08:08,059 INFO [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~467 B/467, heapSize ~1.22 KB/1248, currentSize=0 B/0 for 0a4a68a8fcbff03045cb8a10cb16e91f in 27ms, sequenceid=6, compaction requested=false 2023-07-23 15:08:08,059 INFO [rs(jenkins-hbase4.apache.org,34279,1690124809505)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.80 KB/2869, heapSize ~6.28 KB/6432, currentSize=0 B/0 for bbd1a26a126212ba5ef5066fefc2c4f6 in 27ms, sequenceid=6, compaction requested=false 2023-07-23 15:08:08,059 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-23 15:08:08,059 DEBUG [rs(jenkins-hbase4.apache.org,34279,1690124809505)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-23 15:08:08,062 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0a4a68a8fcbff03045cb8a10cb16e91f: 2023-07-23 15:08:08,062 DEBUG [rs(jenkins-hbase4.apache.org,34279,1690124809505)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for bbd1a26a126212ba5ef5066fefc2c4f6: 2023-07-23 15:08:08,063 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1690124886982.0a4a68a8fcbff03045cb8a10cb16e91f.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,063 DEBUG [rs(jenkins-hbase4.apache.org,34279,1690124809505)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1690124886982.bbd1a26a126212ba5ef5066fefc2c4f6.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,063 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 15:08:08,063 DEBUG [rs(jenkins-hbase4.apache.org,34279,1690124809505)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 15:08:08,063 DEBUG [rs(jenkins-hbase4.apache.org,34279,1690124809505)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithMergeRegion/bbd1a26a126212ba5ef5066fefc2c4f6/cf/bf0431f3f08f4cbf80ace843298b5ec3] hfiles 2023-07-23 15:08:08,063 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithMergeRegion/0a4a68a8fcbff03045cb8a10cb16e91f/cf/6efa3c6054004533a0470ac91fac3540] hfiles 2023-07-23 15:08:08,063 DEBUG [rs(jenkins-hbase4.apache.org,34279,1690124809505)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithMergeRegion/bbd1a26a126212ba5ef5066fefc2c4f6/cf/bf0431f3f08f4cbf80ace843298b5ec3 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,063 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithMergeRegion/0a4a68a8fcbff03045cb8a10cb16e91f/cf/6efa3c6054004533a0470ac91fac3540 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,075 DEBUG [rs(jenkins-hbase4.apache.org,34279,1690124809505)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690124886982.bbd1a26a126212ba5ef5066fefc2c4f6. completed. 2023-07-23 15:08:08,075 DEBUG [rs(jenkins-hbase4.apache.org,34279,1690124809505)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690124886982.bbd1a26a126212ba5ef5066fefc2c4f6. 2023-07-23 15:08:08,075 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 15:08:08,075 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 15:08:08,075 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:08,075 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-23 15:08:08,075 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,34279,1690124809505' in zk 2023-07-23 15:08:08,075 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690124886982.0a4a68a8fcbff03045cb8a10cb16e91f. completed. 2023-07-23 15:08:08,075 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690124886982.0a4a68a8fcbff03045cb8a10cb16e91f. 2023-07-23 15:08:08,076 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 15:08:08,076 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 15:08:08,076 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:08,076 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-23 15:08:08,076 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,46191,1690124809654' in zk 2023-07-23 15:08:08,078 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:08,078 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-23 15:08:08,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:08,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:08:08,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:08:08,078 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:08:08,078 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-23 15:08:08,080 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:08,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:08:08,080 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-23 15:08:08,080 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:08:08,080 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-23 15:08:08,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:08:08,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:08,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:08,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:08,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:08:08,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:08,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:08,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:08,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,34279,1690124809505': 2023-07-23 15:08:08,083 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34279,1690124809505' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-23 15:08:08,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:08,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:08:08,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:08:08,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:08:08,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:08:08,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:08,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:08,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:08,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:08:08,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:08,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:08,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:08,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,46191,1690124809654': 2023-07-23 15:08:08,086 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46191,1690124809654' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-23 15:08:08,086 INFO [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-23 15:08:08,087 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 15:08:08,087 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 15:08:08,087 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,087 INFO [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 15:08:08,092 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,092 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:08:08,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:08:08,092 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,092 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,092 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,092 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,092 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:08,092 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:08,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:08:08,092 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:08,092 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,092 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:08,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:08,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:08,093 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:08,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:08,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:08,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:08,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:08:08,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:08,093 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:08,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:08,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:08,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:08,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:08:08,095 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:08,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,095 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:08,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:08,095 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:08,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:08,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:08,098 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:08,098 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:08,098 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:08,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:08,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:08,098 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:08:08,098 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,098 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,099 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:08,099 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,099 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:08,098 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:08,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:08,098 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:08,098 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:08,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:08,099 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:08,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:08,099 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 15:08:08,100 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,099 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,100 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:08,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:08,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:08,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:08,100 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:08,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:08,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:08,100 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:08,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:08,100 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:08,101 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,101 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-23 15:08:08,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-23 15:08:08,101 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 15:08:08,117 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,152 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-23 15:08:08,152 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,152 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,153 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1690124887998Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1690124888099 (+101 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1690124888099Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1690124888103 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1690124888110 (+7 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1690124888152 (+42 ms) 2023-07-23 15:08:08,155 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-23 15:08:08,157 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 156 msec 2023-07-23 15:08:08,301 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 15:08:08,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-23 15:08:08,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 15:08:08,337 DEBUG [Listener at jenkins-hbase4.apache.org/33035] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-23 15:08:08,342 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43756, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-23 15:08:08,344 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34279] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-23 15:08:08,344 DEBUG [Listener at jenkins-hbase4.apache.org/33035] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-23 15:08:08,349 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46982, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-23 15:08:08,349 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46191] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-23 15:08:08,349 DEBUG [Listener at jenkins-hbase4.apache.org/33035] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-23 15:08:08,352 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48040, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-23 15:08:08,352 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46239] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-23 15:08:08,354 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-23 15:08:08,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:08,357 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-23 15:08:08,357 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-23 15:08:08,358 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-23 15:08:08,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-23 15:08:08,361 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2421fe61afb5bef4d4d8ebdf48099b91 2023-07-23 15:08:08,361 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/61a80bc9be86c4859dcde533febc7719 2023-07-23 15:08:08,362 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2421fe61afb5bef4d4d8ebdf48099b91 empty. 2023-07-23 15:08:08,362 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/61a80bc9be86c4859dcde533febc7719 empty. 2023-07-23 15:08:08,362 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2421fe61afb5bef4d4d8ebdf48099b91 2023-07-23 15:08:08,362 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/61a80bc9be86c4859dcde533febc7719 2023-07-23 15:08:08,362 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-23 15:08:08,372 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-23 15:08:08,373 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 2421fe61afb5bef4d4d8ebdf48099b91, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888354.2421fe61afb5bef4d4d8ebdf48099b91.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp 2023-07-23 15:08:08,373 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 61a80bc9be86c4859dcde533febc7719, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1690124888354.61a80bc9be86c4859dcde533febc7719.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp 2023-07-23 15:08:08,386 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888354.2421fe61afb5bef4d4d8ebdf48099b91.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:08:08,386 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1690124888354.61a80bc9be86c4859dcde533febc7719.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:08:08,386 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 2421fe61afb5bef4d4d8ebdf48099b91, disabling compactions & flushes 2023-07-23 15:08:08,386 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 61a80bc9be86c4859dcde533febc7719, disabling compactions & flushes 2023-07-23 15:08:08,386 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888354.2421fe61afb5bef4d4d8ebdf48099b91. 2023-07-23 15:08:08,386 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690124888354.61a80bc9be86c4859dcde533febc7719. 2023-07-23 15:08:08,386 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888354.2421fe61afb5bef4d4d8ebdf48099b91. 2023-07-23 15:08:08,386 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690124888354.61a80bc9be86c4859dcde533febc7719. 2023-07-23 15:08:08,386 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888354.2421fe61afb5bef4d4d8ebdf48099b91. after waiting 0 ms 2023-07-23 15:08:08,386 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690124888354.61a80bc9be86c4859dcde533febc7719. after waiting 0 ms 2023-07-23 15:08:08,386 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888354.2421fe61afb5bef4d4d8ebdf48099b91. 2023-07-23 15:08:08,386 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690124888354.61a80bc9be86c4859dcde533febc7719. 2023-07-23 15:08:08,386 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888354.2421fe61afb5bef4d4d8ebdf48099b91. 2023-07-23 15:08:08,386 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1690124888354.61a80bc9be86c4859dcde533febc7719. 2023-07-23 15:08:08,387 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 61a80bc9be86c4859dcde533febc7719: 2023-07-23 15:08:08,387 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 2421fe61afb5bef4d4d8ebdf48099b91: 2023-07-23 15:08:08,389 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-23 15:08:08,390 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690124888354.61a80bc9be86c4859dcde533febc7719.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690124888389"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690124888389"}]},"ts":"1690124888389"} 2023-07-23 15:08:08,390 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888354.2421fe61afb5bef4d4d8ebdf48099b91.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690124888389"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690124888389"}]},"ts":"1690124888389"} 2023-07-23 15:08:08,392 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-23 15:08:08,393 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-23 15:08:08,393 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690124888393"}]},"ts":"1690124888393"} 2023-07-23 15:08:08,394 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-23 15:08:08,397 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-23 15:08:08,398 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-23 15:08:08,398 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-23 15:08:08,398 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-23 15:08:08,398 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-23 15:08:08,398 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2421fe61afb5bef4d4d8ebdf48099b91, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=61a80bc9be86c4859dcde533febc7719, ASSIGN}] 2023-07-23 15:08:08,400 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=61a80bc9be86c4859dcde533febc7719, ASSIGN 2023-07-23 15:08:08,401 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2421fe61afb5bef4d4d8ebdf48099b91, ASSIGN 2023-07-23 15:08:08,401 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=61a80bc9be86c4859dcde533febc7719, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34279,1690124809505; forceNewPlan=false, retain=false 2023-07-23 15:08:08,401 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2421fe61afb5bef4d4d8ebdf48099b91, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46191,1690124809654; forceNewPlan=false, retain=false 2023-07-23 15:08:08,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-23 15:08:08,551 INFO [jenkins-hbase4:38379] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-23 15:08:08,555 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=61a80bc9be86c4859dcde533febc7719, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:08,555 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=2421fe61afb5bef4d4d8ebdf48099b91, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:08,555 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690124888354.61a80bc9be86c4859dcde533febc7719.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690124888555"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690124888555"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690124888555"}]},"ts":"1690124888555"} 2023-07-23 15:08:08,555 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888354.2421fe61afb5bef4d4d8ebdf48099b91.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690124888555"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690124888555"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690124888555"}]},"ts":"1690124888555"} 2023-07-23 15:08:08,558 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure 61a80bc9be86c4859dcde533febc7719, server=jenkins-hbase4.apache.org,34279,1690124809505}] 2023-07-23 15:08:08,559 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure 2421fe61afb5bef4d4d8ebdf48099b91, server=jenkins-hbase4.apache.org,46191,1690124809654}] 2023-07-23 15:08:08,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-23 15:08:08,713 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1690124888354.61a80bc9be86c4859dcde533febc7719. 2023-07-23 15:08:08,713 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888354.2421fe61afb5bef4d4d8ebdf48099b91. 2023-07-23 15:08:08,713 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 61a80bc9be86c4859dcde533febc7719, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1690124888354.61a80bc9be86c4859dcde533febc7719.', STARTKEY => '2', ENDKEY => ''} 2023-07-23 15:08:08,713 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2421fe61afb5bef4d4d8ebdf48099b91, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888354.2421fe61afb5bef4d4d8ebdf48099b91.', STARTKEY => '', ENDKEY => '2'} 2023-07-23 15:08:08,713 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888354.2421fe61afb5bef4d4d8ebdf48099b91. service=AccessControlService 2023-07-23 15:08:08,713 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1690124888354.61a80bc9be86c4859dcde533febc7719. service=AccessControlService 2023-07-23 15:08:08,714 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 15:08:08,714 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 15:08:08,714 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 2421fe61afb5bef4d4d8ebdf48099b91 2023-07-23 15:08:08,714 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 61a80bc9be86c4859dcde533febc7719 2023-07-23 15:08:08,714 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888354.2421fe61afb5bef4d4d8ebdf48099b91.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:08:08,714 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1690124888354.61a80bc9be86c4859dcde533febc7719.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:08:08,714 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2421fe61afb5bef4d4d8ebdf48099b91 2023-07-23 15:08:08,714 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 61a80bc9be86c4859dcde533febc7719 2023-07-23 15:08:08,714 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2421fe61afb5bef4d4d8ebdf48099b91 2023-07-23 15:08:08,714 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 61a80bc9be86c4859dcde533febc7719 2023-07-23 15:08:08,715 INFO [StoreOpener-61a80bc9be86c4859dcde533febc7719-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 61a80bc9be86c4859dcde533febc7719 2023-07-23 15:08:08,715 INFO [StoreOpener-2421fe61afb5bef4d4d8ebdf48099b91-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2421fe61afb5bef4d4d8ebdf48099b91 2023-07-23 15:08:08,717 DEBUG [StoreOpener-61a80bc9be86c4859dcde533febc7719-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/61a80bc9be86c4859dcde533febc7719/cf 2023-07-23 15:08:08,717 DEBUG [StoreOpener-61a80bc9be86c4859dcde533febc7719-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/61a80bc9be86c4859dcde533febc7719/cf 2023-07-23 15:08:08,717 DEBUG [StoreOpener-2421fe61afb5bef4d4d8ebdf48099b91-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2421fe61afb5bef4d4d8ebdf48099b91/cf 2023-07-23 15:08:08,717 DEBUG [StoreOpener-2421fe61afb5bef4d4d8ebdf48099b91-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2421fe61afb5bef4d4d8ebdf48099b91/cf 2023-07-23 15:08:08,717 INFO [StoreOpener-2421fe61afb5bef4d4d8ebdf48099b91-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2421fe61afb5bef4d4d8ebdf48099b91 columnFamilyName cf 2023-07-23 15:08:08,717 INFO [StoreOpener-61a80bc9be86c4859dcde533febc7719-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 61a80bc9be86c4859dcde533febc7719 columnFamilyName cf 2023-07-23 15:08:08,718 INFO [StoreOpener-61a80bc9be86c4859dcde533febc7719-1] regionserver.HStore(310): Store=61a80bc9be86c4859dcde533febc7719/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 15:08:08,718 INFO [StoreOpener-2421fe61afb5bef4d4d8ebdf48099b91-1] regionserver.HStore(310): Store=2421fe61afb5bef4d4d8ebdf48099b91/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 15:08:08,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2421fe61afb5bef4d4d8ebdf48099b91 2023-07-23 15:08:08,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2421fe61afb5bef4d4d8ebdf48099b91 2023-07-23 15:08:08,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/61a80bc9be86c4859dcde533febc7719 2023-07-23 15:08:08,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/61a80bc9be86c4859dcde533febc7719 2023-07-23 15:08:08,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2421fe61afb5bef4d4d8ebdf48099b91 2023-07-23 15:08:08,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 61a80bc9be86c4859dcde533febc7719 2023-07-23 15:08:08,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2421fe61afb5bef4d4d8ebdf48099b91/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 15:08:08,725 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2421fe61afb5bef4d4d8ebdf48099b91; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66594125, jitterRate=-0.007670208811759949}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 15:08:08,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2421fe61afb5bef4d4d8ebdf48099b91: 2023-07-23 15:08:08,726 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/61a80bc9be86c4859dcde533febc7719/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 15:08:08,726 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888354.2421fe61afb5bef4d4d8ebdf48099b91., pid=70, masterSystemTime=1690124888710 2023-07-23 15:08:08,726 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 61a80bc9be86c4859dcde533febc7719; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69926058, jitterRate=0.041979461908340454}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 15:08:08,726 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 61a80bc9be86c4859dcde533febc7719: 2023-07-23 15:08:08,727 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1690124888354.61a80bc9be86c4859dcde533febc7719., pid=69, masterSystemTime=1690124888710 2023-07-23 15:08:08,727 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888354.2421fe61afb5bef4d4d8ebdf48099b91. 2023-07-23 15:08:08,727 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888354.2421fe61afb5bef4d4d8ebdf48099b91. 2023-07-23 15:08:08,728 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=2421fe61afb5bef4d4d8ebdf48099b91, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:08,728 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888354.2421fe61afb5bef4d4d8ebdf48099b91.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690124888728"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690124888728"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690124888728"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690124888728"}]},"ts":"1690124888728"} 2023-07-23 15:08:08,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1690124888354.61a80bc9be86c4859dcde533febc7719. 2023-07-23 15:08:08,729 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1690124888354.61a80bc9be86c4859dcde533febc7719. 2023-07-23 15:08:08,729 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=61a80bc9be86c4859dcde533febc7719, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:08,729 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690124888354.61a80bc9be86c4859dcde533febc7719.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690124888729"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690124888729"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690124888729"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690124888729"}]},"ts":"1690124888729"} 2023-07-23 15:08:08,732 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=67 2023-07-23 15:08:08,732 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure 2421fe61afb5bef4d4d8ebdf48099b91, server=jenkins-hbase4.apache.org,46191,1690124809654 in 171 msec 2023-07-23 15:08:08,733 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=68 2023-07-23 15:08:08,733 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure 61a80bc9be86c4859dcde533febc7719, server=jenkins-hbase4.apache.org,34279,1690124809505 in 173 msec 2023-07-23 15:08:08,734 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2421fe61afb5bef4d4d8ebdf48099b91, ASSIGN in 334 msec 2023-07-23 15:08:08,740 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=66 2023-07-23 15:08:08,740 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=61a80bc9be86c4859dcde533febc7719, ASSIGN in 335 msec 2023-07-23 15:08:08,741 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-23 15:08:08,741 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690124888741"}]},"ts":"1690124888741"} 2023-07-23 15:08:08,742 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-23 15:08:08,749 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-23 15:08:08,750 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-23 15:08:08,753 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34279] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-23 15:08:08,755 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:08:08,755 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:08:08,756 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 15:08:08,757 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 15:08:08,758 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:08:08,758 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:08:08,760 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:08,760 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:08,760 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-23 15:08:08,761 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-23 15:08:08,763 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 15:08:08,763 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 15:08:08,763 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 406 msec 2023-07-23 15:08:08,763 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-23 15:08:08,763 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-23 15:08:08,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-23 15:08:08,962 INFO [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-23 15:08:08,991 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 2421fe61afb5bef4d4d8ebdf48099b91, 61a80bc9be86c4859dcde533febc7719 2023-07-23 15:08:09,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[2421fe61afb5bef4d4d8ebdf48099b91, 61a80bc9be86c4859dcde533febc7719], force=true 2023-07-23 15:08:09,003 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[2421fe61afb5bef4d4d8ebdf48099b91, 61a80bc9be86c4859dcde533febc7719], force=true 2023-07-23 15:08:09,003 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[2421fe61afb5bef4d4d8ebdf48099b91, 61a80bc9be86c4859dcde533febc7719], force=true 2023-07-23 15:08:09,003 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[2421fe61afb5bef4d4d8ebdf48099b91, 61a80bc9be86c4859dcde533febc7719], force=true 2023-07-23 15:08:09,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-23 15:08:09,027 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2421fe61afb5bef4d4d8ebdf48099b91, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=61a80bc9be86c4859dcde533febc7719, UNASSIGN}] 2023-07-23 15:08:09,029 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2421fe61afb5bef4d4d8ebdf48099b91, UNASSIGN 2023-07-23 15:08:09,029 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=61a80bc9be86c4859dcde533febc7719, UNASSIGN 2023-07-23 15:08:09,030 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=2421fe61afb5bef4d4d8ebdf48099b91, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:09,030 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=61a80bc9be86c4859dcde533febc7719, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:09,030 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888354.2421fe61afb5bef4d4d8ebdf48099b91.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690124889030"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690124889030"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690124889030"}]},"ts":"1690124889030"} 2023-07-23 15:08:09,030 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690124888354.61a80bc9be86c4859dcde533febc7719.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690124889030"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690124889030"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690124889030"}]},"ts":"1690124889030"} 2023-07-23 15:08:09,032 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure 2421fe61afb5bef4d4d8ebdf48099b91, server=jenkins-hbase4.apache.org,46191,1690124809654}] 2023-07-23 15:08:09,033 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 61a80bc9be86c4859dcde533febc7719, server=jenkins-hbase4.apache.org,34279,1690124809505}] 2023-07-23 15:08:09,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-23 15:08:09,184 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 2421fe61afb5bef4d4d8ebdf48099b91 2023-07-23 15:08:09,186 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2421fe61afb5bef4d4d8ebdf48099b91, disabling compactions & flushes 2023-07-23 15:08:09,186 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888354.2421fe61afb5bef4d4d8ebdf48099b91. 2023-07-23 15:08:09,186 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888354.2421fe61afb5bef4d4d8ebdf48099b91. 2023-07-23 15:08:09,186 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888354.2421fe61afb5bef4d4d8ebdf48099b91. after waiting 0 ms 2023-07-23 15:08:09,186 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888354.2421fe61afb5bef4d4d8ebdf48099b91. 2023-07-23 15:08:09,186 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 2421fe61afb5bef4d4d8ebdf48099b91 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-23 15:08:09,186 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 61a80bc9be86c4859dcde533febc7719 2023-07-23 15:08:09,187 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 61a80bc9be86c4859dcde533febc7719, disabling compactions & flushes 2023-07-23 15:08:09,188 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690124888354.61a80bc9be86c4859dcde533febc7719. 2023-07-23 15:08:09,188 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690124888354.61a80bc9be86c4859dcde533febc7719. 2023-07-23 15:08:09,188 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690124888354.61a80bc9be86c4859dcde533febc7719. after waiting 0 ms 2023-07-23 15:08:09,188 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690124888354.61a80bc9be86c4859dcde533febc7719. 2023-07-23 15:08:09,188 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 61a80bc9be86c4859dcde533febc7719 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-23 15:08:09,203 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/61a80bc9be86c4859dcde533febc7719/.tmp/cf/211ae02ed9bd41a880d1ebd4a726a15c 2023-07-23 15:08:09,206 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2421fe61afb5bef4d4d8ebdf48099b91/.tmp/cf/606f5b97eb9e4a35bb87a6cc2205f376 2023-07-23 15:08:09,211 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/61a80bc9be86c4859dcde533febc7719/.tmp/cf/211ae02ed9bd41a880d1ebd4a726a15c as hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/61a80bc9be86c4859dcde533febc7719/cf/211ae02ed9bd41a880d1ebd4a726a15c 2023-07-23 15:08:09,212 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2421fe61afb5bef4d4d8ebdf48099b91/.tmp/cf/606f5b97eb9e4a35bb87a6cc2205f376 as hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2421fe61afb5bef4d4d8ebdf48099b91/cf/606f5b97eb9e4a35bb87a6cc2205f376 2023-07-23 15:08:09,219 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2421fe61afb5bef4d4d8ebdf48099b91/cf/606f5b97eb9e4a35bb87a6cc2205f376, entries=1, sequenceid=5, filesize=4.7 K 2023-07-23 15:08:09,221 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 2421fe61afb5bef4d4d8ebdf48099b91 in 35ms, sequenceid=5, compaction requested=false 2023-07-23 15:08:09,221 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-23 15:08:09,228 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/61a80bc9be86c4859dcde533febc7719/cf/211ae02ed9bd41a880d1ebd4a726a15c, entries=1, sequenceid=5, filesize=4.7 K 2023-07-23 15:08:09,230 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 61a80bc9be86c4859dcde533febc7719 in 42ms, sequenceid=5, compaction requested=false 2023-07-23 15:08:09,252 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2421fe61afb5bef4d4d8ebdf48099b91/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-23 15:08:09,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 15:08:09,253 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888354.2421fe61afb5bef4d4d8ebdf48099b91. 2023-07-23 15:08:09,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2421fe61afb5bef4d4d8ebdf48099b91: 2023-07-23 15:08:09,255 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 2421fe61afb5bef4d4d8ebdf48099b91 2023-07-23 15:08:09,255 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=2421fe61afb5bef4d4d8ebdf48099b91, regionState=CLOSED 2023-07-23 15:08:09,255 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888354.2421fe61afb5bef4d4d8ebdf48099b91.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690124889255"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690124889255"}]},"ts":"1690124889255"} 2023-07-23 15:08:09,256 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/61a80bc9be86c4859dcde533febc7719/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-23 15:08:09,256 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 15:08:09,256 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1690124888354.61a80bc9be86c4859dcde533febc7719. 2023-07-23 15:08:09,256 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 61a80bc9be86c4859dcde533febc7719: 2023-07-23 15:08:09,258 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 61a80bc9be86c4859dcde533febc7719 2023-07-23 15:08:09,258 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=61a80bc9be86c4859dcde533febc7719, regionState=CLOSED 2023-07-23 15:08:09,259 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690124888354.61a80bc9be86c4859dcde533febc7719.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690124889258"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690124889258"}]},"ts":"1690124889258"} 2023-07-23 15:08:09,259 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=72 2023-07-23 15:08:09,259 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure 2421fe61afb5bef4d4d8ebdf48099b91, server=jenkins-hbase4.apache.org,46191,1690124809654 in 225 msec 2023-07-23 15:08:09,260 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2421fe61afb5bef4d4d8ebdf48099b91, UNASSIGN in 235 msec 2023-07-23 15:08:09,262 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=73 2023-07-23 15:08:09,262 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 61a80bc9be86c4859dcde533febc7719, server=jenkins-hbase4.apache.org,34279,1690124809505 in 227 msec 2023-07-23 15:08:09,263 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=71 2023-07-23 15:08:09,263 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=61a80bc9be86c4859dcde533febc7719, UNASSIGN in 235 msec 2023-07-23 15:08:09,308 DEBUG [PEWorker-3] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/506e3085f5edd546f89d016f36da3bee/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-23 15:08:09,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-23 15:08:09,310 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888354.2421fe61afb5bef4d4d8ebdf48099b91.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-23 15:08:09,310 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690124888354.61a80bc9be86c4859dcde533febc7719.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-23 15:08:09,310 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888355.506e3085f5edd546f89d016f36da3bee.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-23 15:08:09,358 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=506e3085f5edd546f89d016f36da3bee, ASSIGN}] 2023-07-23 15:08:09,359 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=506e3085f5edd546f89d016f36da3bee, ASSIGN 2023-07-23 15:08:09,360 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=506e3085f5edd546f89d016f36da3bee, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,46191,1690124809654; forceNewPlan=false, retain=false 2023-07-23 15:08:09,510 INFO [jenkins-hbase4:38379] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-23 15:08:09,512 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=506e3085f5edd546f89d016f36da3bee, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:09,513 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888355.506e3085f5edd546f89d016f36da3bee.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690124889512"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690124889512"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690124889512"}]},"ts":"1690124889512"} 2023-07-23 15:08:09,514 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 506e3085f5edd546f89d016f36da3bee, server=jenkins-hbase4.apache.org,46191,1690124809654}] 2023-07-23 15:08:09,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-23 15:08:09,671 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888355.506e3085f5edd546f89d016f36da3bee. 2023-07-23 15:08:09,671 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 506e3085f5edd546f89d016f36da3bee, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888355.506e3085f5edd546f89d016f36da3bee.', STARTKEY => '', ENDKEY => ''} 2023-07-23 15:08:09,672 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888355.506e3085f5edd546f89d016f36da3bee. service=AccessControlService 2023-07-23 15:08:09,672 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 15:08:09,672 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 506e3085f5edd546f89d016f36da3bee 2023-07-23 15:08:09,672 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888355.506e3085f5edd546f89d016f36da3bee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:08:09,672 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 506e3085f5edd546f89d016f36da3bee 2023-07-23 15:08:09,672 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 506e3085f5edd546f89d016f36da3bee 2023-07-23 15:08:09,674 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/506e3085f5edd546f89d016f36da3bee/.regioninfo 2023-07-23 15:08:09,692 INFO [StoreOpener-506e3085f5edd546f89d016f36da3bee-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 506e3085f5edd546f89d016f36da3bee 2023-07-23 15:08:09,693 DEBUG [StoreOpener-506e3085f5edd546f89d016f36da3bee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/506e3085f5edd546f89d016f36da3bee/cf 2023-07-23 15:08:09,693 DEBUG [StoreOpener-506e3085f5edd546f89d016f36da3bee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/506e3085f5edd546f89d016f36da3bee/cf 2023-07-23 15:08:09,694 INFO [StoreOpener-506e3085f5edd546f89d016f36da3bee-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 506e3085f5edd546f89d016f36da3bee columnFamilyName cf 2023-07-23 15:08:09,726 DEBUG [StoreOpener-506e3085f5edd546f89d016f36da3bee-1] regionserver.HStore(539): loaded hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/506e3085f5edd546f89d016f36da3bee/cf/211ae02ed9bd41a880d1ebd4a726a15c.61a80bc9be86c4859dcde533febc7719->hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/61a80bc9be86c4859dcde533febc7719/cf/211ae02ed9bd41a880d1ebd4a726a15c-top 2023-07-23 15:08:09,734 DEBUG [StoreOpener-506e3085f5edd546f89d016f36da3bee-1] regionserver.HStore(539): loaded hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/506e3085f5edd546f89d016f36da3bee/cf/606f5b97eb9e4a35bb87a6cc2205f376.2421fe61afb5bef4d4d8ebdf48099b91->hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2421fe61afb5bef4d4d8ebdf48099b91/cf/606f5b97eb9e4a35bb87a6cc2205f376-top 2023-07-23 15:08:09,735 INFO [StoreOpener-506e3085f5edd546f89d016f36da3bee-1] regionserver.HStore(310): Store=506e3085f5edd546f89d016f36da3bee/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 15:08:09,736 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/506e3085f5edd546f89d016f36da3bee 2023-07-23 15:08:09,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/506e3085f5edd546f89d016f36da3bee 2023-07-23 15:08:09,742 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 506e3085f5edd546f89d016f36da3bee 2023-07-23 15:08:09,743 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 506e3085f5edd546f89d016f36da3bee; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63235790, jitterRate=-0.05771329998970032}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 15:08:09,743 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 506e3085f5edd546f89d016f36da3bee: 2023-07-23 15:08:09,744 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888355.506e3085f5edd546f89d016f36da3bee., pid=77, masterSystemTime=1690124889666 2023-07-23 15:08:09,744 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888355.506e3085f5edd546f89d016f36da3bee.,because compaction is disabled. 2023-07-23 15:08:09,748 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888355.506e3085f5edd546f89d016f36da3bee. 2023-07-23 15:08:09,748 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888355.506e3085f5edd546f89d016f36da3bee. 2023-07-23 15:08:09,749 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=506e3085f5edd546f89d016f36da3bee, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:09,749 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888355.506e3085f5edd546f89d016f36da3bee.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690124889749"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690124889749"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690124889749"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690124889749"}]},"ts":"1690124889749"} 2023-07-23 15:08:09,753 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-23 15:08:09,753 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 506e3085f5edd546f89d016f36da3bee, server=jenkins-hbase4.apache.org,46191,1690124809654 in 237 msec 2023-07-23 15:08:09,755 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-23 15:08:09,755 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=506e3085f5edd546f89d016f36da3bee, ASSIGN in 395 msec 2023-07-23 15:08:09,759 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[2421fe61afb5bef4d4d8ebdf48099b91, 61a80bc9be86c4859dcde533febc7719], force=true in 760 msec 2023-07-23 15:08:10,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-23 15:08:10,111 INFO [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-23 15:08:10,111 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-23 15:08:10,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690124890111 (current time:1690124890111). 2023-07-23 15:08:10,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 15:08:10,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] zookeeper.ReadOnlyZKClient(139): Connect 0x49ddb8cf to 127.0.0.1:51019 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 15:08:10,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6bfef832, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 15:08:10,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:08:10,121 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43764, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:08:10,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x49ddb8cf to 127.0.0.1:51019 2023-07-23 15:08:10,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 15:08:10,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] zookeeper.ReadOnlyZKClient(139): Connect 0x6a912c9e to 127.0.0.1:51019 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 15:08:10,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4e2efac3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 15:08:10,129 DEBUG [hconnection-0x520db45c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:08:10,132 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43766, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:08:10,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6a912c9e to 127.0.0.1:51019 2023-07-23 15:08:10,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 15:08:10,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-23 15:08:10,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 15:08:10,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-23 15:08:10,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-23 15:08:10,140 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-23 15:08:10,141 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1690125490141 2023-07-23 15:08:10,141 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-23 15:08:10,145 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 15:08:10,145 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 15:08:10,146 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-23 15:08:10,146 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-23 15:08:10,147 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 8 msec 2023-07-23 15:08:10,148 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-23 15:08:10,149 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1690125490149 2023-07-23 15:08:10,162 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,163 INFO [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-23 15:08:10,163 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:08:10,164 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-23 15:08:10,164 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-23 15:08:10,164 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,164 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,166 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:10,166 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:10,166 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:10,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:10,166 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:10,166 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:10,166 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:10,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:10,166 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:10,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:10,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,167 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,167 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:10,167 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 15:08:10,167 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-23 15:08:10,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,168 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-23 15:08:10,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-23 15:08:10,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,168 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,168 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,168 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-23 15:08:10,168 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:08:10,168 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-23 15:08:10,170 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-23 15:08:10,171 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-23 15:08:10,171 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46191,1690124809654' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-23 15:08:10,171 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,171 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-23 15:08:10,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-23 15:08:10,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,171 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:08:10,173 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-23 15:08:10,173 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-23 15:08:10,173 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34279,1690124809505' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-23 15:08:10,173 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-23 15:08:10,174 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,175 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-23 15:08:10,175 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:08:10,176 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-23 15:08:10,176 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-23 15:08:10,176 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46239,1690124809597' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-23 15:08:10,180 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,183 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,183 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:08:10,183 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:10,183 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:10,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:08:10,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:08:10,184 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:08:10,184 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,184 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:08:10,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:08:10,184 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,185 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:08:10,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:10,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:10,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:10,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:08:10,187 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46191,1690124809654' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-23 15:08:10,187 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@12672ae2[Count = 0] remaining members to acquire global barrier 2023-07-23 15:08:10,187 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-23 15:08:10,187 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,188 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,188 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,189 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-23 15:08:10,189 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,189 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-23 15:08:10,189 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,46239,1690124809597' in zk 2023-07-23 15:08:10,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,189 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-23 15:08:10,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,189 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:10,189 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 15:08:10,189 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-23 15:08:10,189 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-23 15:08:10,190 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,34279,1690124809505' in zk 2023-07-23 15:08:10,190 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 15:08:10,190 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 15:08:10,190 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888355.506e3085f5edd546f89d016f36da3bee. 2023-07-23 15:08:10,191 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888355.506e3085f5edd546f89d016f36da3bee. started... 2023-07-23 15:08:10,192 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 506e3085f5edd546f89d016f36da3bee: 2023-07-23 15:08:10,192 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-23 15:08:10,192 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:08:10,192 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888355.506e3085f5edd546f89d016f36da3bee.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,192 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-23 15:08:10,192 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 15:08:10,194 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-23 15:08:10,194 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/506e3085f5edd546f89d016f36da3bee/cf/211ae02ed9bd41a880d1ebd4a726a15c.61a80bc9be86c4859dcde533febc7719->hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/61a80bc9be86c4859dcde533febc7719/cf/211ae02ed9bd41a880d1ebd4a726a15c-top, hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/506e3085f5edd546f89d016f36da3bee/cf/606f5b97eb9e4a35bb87a6cc2205f376.2421fe61afb5bef4d4d8ebdf48099b91->hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2421fe61afb5bef4d4d8ebdf48099b91/cf/606f5b97eb9e4a35bb87a6cc2205f376-top] hfiles 2023-07-23 15:08:10,194 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/506e3085f5edd546f89d016f36da3bee/cf/211ae02ed9bd41a880d1ebd4a726a15c.61a80bc9be86c4859dcde533febc7719 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,194 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:08:10,195 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-23 15:08:10,198 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/506e3085f5edd546f89d016f36da3bee/cf/606f5b97eb9e4a35bb87a6cc2205f376.2421fe61afb5bef4d4d8ebdf48099b91 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,213 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888355.506e3085f5edd546f89d016f36da3bee. completed. 2023-07-23 15:08:10,213 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888355.506e3085f5edd546f89d016f36da3bee. 2023-07-23 15:08:10,213 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 15:08:10,213 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 15:08:10,213 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:10,213 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-23 15:08:10,213 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,46191,1690124809654' in zk 2023-07-23 15:08:10,218 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:10,218 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-23 15:08:10,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:10,218 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:08:10,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:08:10,218 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-23 15:08:10,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:08:10,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:08:10,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:08:10,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:10,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:10,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:10,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:08:10,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:10,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:10,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:10,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,46191,1690124809654': 2023-07-23 15:08:10,222 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46191,1690124809654' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-23 15:08:10,222 INFO [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-23 15:08:10,222 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 15:08:10,222 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 15:08:10,222 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,222 INFO [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 15:08:10,225 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,225 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,227 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:10,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,227 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,227 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:10,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:08:10,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:08:10,227 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,227 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:10,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:08:10,228 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:10,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,228 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:10,228 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:10,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:10,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:10,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,228 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:10,228 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:10,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:10,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:08:10,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,229 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:10,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:10,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:10,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:10,232 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:10,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:08:10,232 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:10,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,233 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:10,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:10,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:10,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:10,235 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:10,235 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:10,235 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:10,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:10,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:10,235 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,236 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:10,236 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:10,236 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:10,236 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:10,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:10,236 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:10,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:10,236 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:10,236 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:08:10,236 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:10,236 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:10,236 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:10,237 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,236 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:10,237 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,237 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:10,237 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,237 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:10,237 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:10,237 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,237 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,238 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:10,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:10,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:10,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:10,246 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 15:08:10,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-23 15:08:10,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-23 15:08:10,247 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 15:08:10,278 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,297 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-23 15:08:10,297 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,297 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,298 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1690124890141Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690124890237 (+96 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690124890237Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690124890253 (+16 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690124890271 (+18 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1690124890297 (+26 ms) 2023-07-23 15:08:10,300 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-23 15:08:10,302 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 155 msec 2023-07-23 15:08:10,447 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 15:08:10,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-23 15:08:10,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 15:08:10,449 INFO [Listener at jenkins-hbase4.apache.org/33035] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/export-test/export-1690124890449 2023-07-23 15:08:10,449 INFO [Listener at jenkins-hbase4.apache.org/33035] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:45535, tgtDir=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/export-test/export-1690124890449, rawTgtDir=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/export-test/export-1690124890449, srcFsUri=hdfs://localhost:45535, srcDir=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40 2023-07-23 15:08:10,470 DEBUG [Listener at jenkins-hbase4.apache.org/33035] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45535, inputRoot=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40 2023-07-23 15:08:10,470 DEBUG [Listener at jenkins-hbase4.apache.org/33035] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1310576048_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/export-test/export-1690124890449, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/export-test/export-1690124890449/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,470 INFO [Listener at jenkins-hbase4.apache.org/33035] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45535, inputRoot=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40, snapshotDir=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-23 15:08:10,479 INFO [Listener at jenkins-hbase4.apache.org/33035] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/export-test/export-1690124890449/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,503 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:10,503 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:10,504 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:10,504 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:10,504 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:10,504 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:10,505 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:10,572 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/hadoop-540270349533466472.jar 2023-07-23 15:08:10,572 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:10,573 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:10,573 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:10,573 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:10,573 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:10,574 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:10,574 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-23 15:08:10,575 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-23 15:08:10,575 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-23 15:08:10,575 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-23 15:08:10,576 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-23 15:08:10,576 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-23 15:08:10,577 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-23 15:08:10,577 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-23 15:08:10,577 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-23 15:08:10,578 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-23 15:08:10,578 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 15:08:10,578 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 15:08:10,579 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 15:08:10,579 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 15:08:10,579 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 15:08:10,579 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 15:08:10,580 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 15:08:10,812 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690124817489_0004_000001 (auth:SIMPLE) 2023-07-23 15:08:11,173 WARN [Listener at jenkins-hbase4.apache.org/33035] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-23 15:08:11,175 INFO [Listener at jenkins-hbase4.apache.org/33035] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-23 15:08:11,177 DEBUG [Listener at jenkins-hbase4.apache.org/33035] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-23 15:08:11,271 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 15:08:11,271 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 15:08:11,481 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690124817489_0005_000001 (auth:SIMPLE) 2023-07-23 15:08:12,277 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-23 15:08:17,940 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690124817489_0005_000001 (auth:SIMPLE) 2023-07-23 15:08:20,229 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690124817489_0005_000001 (auth:SIMPLE) 2023-07-23 15:08:23,511 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690124817489_0005_000001 (auth:SIMPLE) 2023-07-23 15:08:25,442 INFO [Listener at jenkins-hbase4.apache.org/33035] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-23 15:08:25,443 INFO [Listener at jenkins-hbase4.apache.org/33035] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-23 15:08:25,454 INFO [Listener at jenkins-hbase4.apache.org/33035] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:25,454 INFO [Listener at jenkins-hbase4.apache.org/33035] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-23 15:08:25,454 INFO [Listener at jenkins-hbase4.apache.org/33035] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-23 15:08:25,455 DEBUG [Listener at jenkins-hbase4.apache.org/33035] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-979742745_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:25,455 DEBUG [Listener at jenkins-hbase4.apache.org/33035] snapshot.TestExportSnapshot(367): hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-23 15:08:25,455 DEBUG [Listener at jenkins-hbase4.apache.org/33035] snapshot.TestExportSnapshot(367): hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-23 15:08:25,456 DEBUG [Listener at jenkins-hbase4.apache.org/33035] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-979742745_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/export-test/export-1690124890449/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/export-test/export-1690124890449/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:25,456 DEBUG [Listener at jenkins-hbase4.apache.org/33035] snapshot.TestExportSnapshot(367): hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/export-test/export-1690124890449/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-23 15:08:25,456 DEBUG [Listener at jenkins-hbase4.apache.org/33035] snapshot.TestExportSnapshot(367): hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/export-test/export-1690124890449/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-23 15:08:25,464 INFO [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:25,465 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:25,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:25,470 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690124905470"}]},"ts":"1690124905470"} 2023-07-23 15:08:25,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-23 15:08:25,472 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-23 15:08:25,474 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-23 15:08:25,475 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=506e3085f5edd546f89d016f36da3bee, UNASSIGN}] 2023-07-23 15:08:25,477 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=506e3085f5edd546f89d016f36da3bee, UNASSIGN 2023-07-23 15:08:25,478 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=506e3085f5edd546f89d016f36da3bee, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:25,478 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888355.506e3085f5edd546f89d016f36da3bee.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690124905478"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690124905478"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690124905478"}]},"ts":"1690124905478"} 2023-07-23 15:08:25,480 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 506e3085f5edd546f89d016f36da3bee, server=jenkins-hbase4.apache.org,46191,1690124809654}] 2023-07-23 15:08:25,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-23 15:08:25,632 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 506e3085f5edd546f89d016f36da3bee 2023-07-23 15:08:25,633 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 506e3085f5edd546f89d016f36da3bee, disabling compactions & flushes 2023-07-23 15:08:25,633 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888355.506e3085f5edd546f89d016f36da3bee. 2023-07-23 15:08:25,633 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888355.506e3085f5edd546f89d016f36da3bee. 2023-07-23 15:08:25,633 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888355.506e3085f5edd546f89d016f36da3bee. after waiting 0 ms 2023-07-23 15:08:25,633 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888355.506e3085f5edd546f89d016f36da3bee. 2023-07-23 15:08:25,644 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/506e3085f5edd546f89d016f36da3bee/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-23 15:08:25,645 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 15:08:25,646 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888355.506e3085f5edd546f89d016f36da3bee. 2023-07-23 15:08:25,646 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 506e3085f5edd546f89d016f36da3bee: 2023-07-23 15:08:25,649 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 506e3085f5edd546f89d016f36da3bee 2023-07-23 15:08:25,650 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=506e3085f5edd546f89d016f36da3bee, regionState=CLOSED 2023-07-23 15:08:25,650 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888355.506e3085f5edd546f89d016f36da3bee.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690124905650"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690124905650"}]},"ts":"1690124905650"} 2023-07-23 15:08:25,654 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-23 15:08:25,654 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 506e3085f5edd546f89d016f36da3bee, server=jenkins-hbase4.apache.org,46191,1690124809654 in 172 msec 2023-07-23 15:08:25,655 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-23 15:08:25,655 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=506e3085f5edd546f89d016f36da3bee, UNASSIGN in 179 msec 2023-07-23 15:08:25,656 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690124905656"}]},"ts":"1690124905656"} 2023-07-23 15:08:25,663 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-23 15:08:25,665 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-23 15:08:25,667 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 200 msec 2023-07-23 15:08:25,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-23 15:08:25,774 INFO [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-23 15:08:25,775 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:25,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:25,778 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:25,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:25,779 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:25,780 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34279] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:25,784 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:25,784 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:25,785 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:25,784 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:25,785 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-23 15:08:25,785 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-23 15:08:25,785 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-23 15:08:25,785 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-23 15:08:25,788 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:25,788 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:08:25,788 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:25,788 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:08:25,788 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:25,788 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:08:25,789 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/506e3085f5edd546f89d016f36da3bee 2023-07-23 15:08:25,789 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2421fe61afb5bef4d4d8ebdf48099b91 2023-07-23 15:08:25,789 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/61a80bc9be86c4859dcde533febc7719 2023-07-23 15:08:25,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-23 15:08:25,790 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:25,790 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:08:25,790 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 15:08:25,791 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/506e3085f5edd546f89d016f36da3bee/cf, FileablePath, hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/506e3085f5edd546f89d016f36da3bee/recovered.edits] 2023-07-23 15:08:25,793 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2421fe61afb5bef4d4d8ebdf48099b91/cf, FileablePath, hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2421fe61afb5bef4d4d8ebdf48099b91/recovered.edits] 2023-07-23 15:08:25,795 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 15:08:25,795 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 15:08:25,796 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 15:08:25,799 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/61a80bc9be86c4859dcde533febc7719/cf, FileablePath, hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/61a80bc9be86c4859dcde533febc7719/recovered.edits] 2023-07-23 15:08:25,800 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/506e3085f5edd546f89d016f36da3bee/cf/211ae02ed9bd41a880d1ebd4a726a15c.61a80bc9be86c4859dcde533febc7719 to hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/506e3085f5edd546f89d016f36da3bee/cf/211ae02ed9bd41a880d1ebd4a726a15c.61a80bc9be86c4859dcde533febc7719 2023-07-23 15:08:25,802 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/506e3085f5edd546f89d016f36da3bee/cf/606f5b97eb9e4a35bb87a6cc2205f376.2421fe61afb5bef4d4d8ebdf48099b91 to hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/506e3085f5edd546f89d016f36da3bee/cf/606f5b97eb9e4a35bb87a6cc2205f376.2421fe61afb5bef4d4d8ebdf48099b91 2023-07-23 15:08:25,804 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2421fe61afb5bef4d4d8ebdf48099b91/cf/606f5b97eb9e4a35bb87a6cc2205f376 to hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2421fe61afb5bef4d4d8ebdf48099b91/cf/606f5b97eb9e4a35bb87a6cc2205f376 2023-07-23 15:08:25,805 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/61a80bc9be86c4859dcde533febc7719/cf/211ae02ed9bd41a880d1ebd4a726a15c to hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/61a80bc9be86c4859dcde533febc7719/cf/211ae02ed9bd41a880d1ebd4a726a15c 2023-07-23 15:08:25,810 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/61a80bc9be86c4859dcde533febc7719/recovered.edits/8.seqid to hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/61a80bc9be86c4859dcde533febc7719/recovered.edits/8.seqid 2023-07-23 15:08:25,811 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/61a80bc9be86c4859dcde533febc7719 2023-07-23 15:08:25,811 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2421fe61afb5bef4d4d8ebdf48099b91/recovered.edits/8.seqid to hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2421fe61afb5bef4d4d8ebdf48099b91/recovered.edits/8.seqid 2023-07-23 15:08:25,812 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2421fe61afb5bef4d4d8ebdf48099b91 2023-07-23 15:08:25,812 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/506e3085f5edd546f89d016f36da3bee/recovered.edits/12.seqid to hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/506e3085f5edd546f89d016f36da3bee/recovered.edits/12.seqid 2023-07-23 15:08:25,813 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/506e3085f5edd546f89d016f36da3bee 2023-07-23 15:08:25,813 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-23 15:08:25,819 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:25,835 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-23 15:08:25,837 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-23 15:08:25,839 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:25,839 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-23 15:08:25,839 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888355.506e3085f5edd546f89d016f36da3bee.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690124905839"}]},"ts":"9223372036854775807"} 2023-07-23 15:08:25,842 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-23 15:08:25,842 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 506e3085f5edd546f89d016f36da3bee, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888355.506e3085f5edd546f89d016f36da3bee.', STARTKEY => '', ENDKEY => ''}] 2023-07-23 15:08:25,842 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-23 15:08:25,842 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690124905842"}]},"ts":"9223372036854775807"} 2023-07-23 15:08:25,850 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-23 15:08:25,856 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:25,857 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 81 msec 2023-07-23 15:08:25,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-23 15:08:25,891 INFO [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-23 15:08:25,891 INFO [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:25,892 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:25,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:25,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-23 15:08:25,897 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690124905897"}]},"ts":"1690124905897"} 2023-07-23 15:08:25,899 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-23 15:08:25,901 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-23 15:08:25,902 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0a4a68a8fcbff03045cb8a10cb16e91f, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=bbd1a26a126212ba5ef5066fefc2c4f6, UNASSIGN}] 2023-07-23 15:08:25,903 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0a4a68a8fcbff03045cb8a10cb16e91f, UNASSIGN 2023-07-23 15:08:25,905 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=bbd1a26a126212ba5ef5066fefc2c4f6, UNASSIGN 2023-07-23 15:08:25,906 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=0a4a68a8fcbff03045cb8a10cb16e91f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:25,906 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690124886982.0a4a68a8fcbff03045cb8a10cb16e91f.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690124905906"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690124905906"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690124905906"}]},"ts":"1690124905906"} 2023-07-23 15:08:25,906 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=bbd1a26a126212ba5ef5066fefc2c4f6, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:25,906 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690124886982.bbd1a26a126212ba5ef5066fefc2c4f6.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690124905906"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690124905906"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690124905906"}]},"ts":"1690124905906"} 2023-07-23 15:08:25,908 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 0a4a68a8fcbff03045cb8a10cb16e91f, server=jenkins-hbase4.apache.org,46191,1690124809654}] 2023-07-23 15:08:25,909 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure bbd1a26a126212ba5ef5066fefc2c4f6, server=jenkins-hbase4.apache.org,34279,1690124809505}] 2023-07-23 15:08:25,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-23 15:08:26,060 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0a4a68a8fcbff03045cb8a10cb16e91f 2023-07-23 15:08:26,061 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0a4a68a8fcbff03045cb8a10cb16e91f, disabling compactions & flushes 2023-07-23 15:08:26,061 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1690124886982.0a4a68a8fcbff03045cb8a10cb16e91f. 2023-07-23 15:08:26,061 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690124886982.0a4a68a8fcbff03045cb8a10cb16e91f. 2023-07-23 15:08:26,061 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690124886982.0a4a68a8fcbff03045cb8a10cb16e91f. after waiting 0 ms 2023-07-23 15:08:26,061 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1690124886982.0a4a68a8fcbff03045cb8a10cb16e91f. 2023-07-23 15:08:26,065 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close bbd1a26a126212ba5ef5066fefc2c4f6 2023-07-23 15:08:26,065 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing bbd1a26a126212ba5ef5066fefc2c4f6, disabling compactions & flushes 2023-07-23 15:08:26,065 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1690124886982.bbd1a26a126212ba5ef5066fefc2c4f6. 2023-07-23 15:08:26,065 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690124886982.bbd1a26a126212ba5ef5066fefc2c4f6. 2023-07-23 15:08:26,065 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690124886982.bbd1a26a126212ba5ef5066fefc2c4f6. after waiting 0 ms 2023-07-23 15:08:26,066 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1690124886982.bbd1a26a126212ba5ef5066fefc2c4f6. 2023-07-23 15:08:26,073 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithMergeRegion/0a4a68a8fcbff03045cb8a10cb16e91f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 15:08:26,073 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 15:08:26,074 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithMergeRegion/bbd1a26a126212ba5ef5066fefc2c4f6/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 15:08:26,075 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1690124886982.0a4a68a8fcbff03045cb8a10cb16e91f. 2023-07-23 15:08:26,075 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0a4a68a8fcbff03045cb8a10cb16e91f: 2023-07-23 15:08:26,075 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 15:08:26,077 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1690124886982.bbd1a26a126212ba5ef5066fefc2c4f6. 2023-07-23 15:08:26,077 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for bbd1a26a126212ba5ef5066fefc2c4f6: 2023-07-23 15:08:26,078 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0a4a68a8fcbff03045cb8a10cb16e91f 2023-07-23 15:08:26,080 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=0a4a68a8fcbff03045cb8a10cb16e91f, regionState=CLOSED 2023-07-23 15:08:26,081 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690124886982.0a4a68a8fcbff03045cb8a10cb16e91f.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690124906080"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690124906080"}]},"ts":"1690124906080"} 2023-07-23 15:08:26,081 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed bbd1a26a126212ba5ef5066fefc2c4f6 2023-07-23 15:08:26,083 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=bbd1a26a126212ba5ef5066fefc2c4f6, regionState=CLOSED 2023-07-23 15:08:26,083 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690124886982.bbd1a26a126212ba5ef5066fefc2c4f6.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690124906083"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690124906083"}]},"ts":"1690124906083"} 2023-07-23 15:08:26,086 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=85 2023-07-23 15:08:26,086 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 0a4a68a8fcbff03045cb8a10cb16e91f, server=jenkins-hbase4.apache.org,46191,1690124809654 in 175 msec 2023-07-23 15:08:26,089 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=86 2023-07-23 15:08:26,089 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0a4a68a8fcbff03045cb8a10cb16e91f, UNASSIGN in 184 msec 2023-07-23 15:08:26,089 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure bbd1a26a126212ba5ef5066fefc2c4f6, server=jenkins-hbase4.apache.org,34279,1690124809505 in 176 msec 2023-07-23 15:08:26,091 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=86, resume processing ppid=84 2023-07-23 15:08:26,091 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=bbd1a26a126212ba5ef5066fefc2c4f6, UNASSIGN in 187 msec 2023-07-23 15:08:26,092 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690124906092"}]},"ts":"1690124906092"} 2023-07-23 15:08:26,095 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-23 15:08:26,105 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-23 15:08:26,115 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 214 msec 2023-07-23 15:08:26,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-23 15:08:26,199 INFO [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-23 15:08:26,201 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:26,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:26,205 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:26,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:26,206 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:26,208 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34279] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:26,210 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:26,210 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:26,210 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:26,211 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-23 15:08:26,212 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-23 15:08:26,212 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0a4a68a8fcbff03045cb8a10cb16e91f 2023-07-23 15:08:26,212 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/bbd1a26a126212ba5ef5066fefc2c4f6 2023-07-23 15:08:26,213 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:26,213 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:08:26,213 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:26,213 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:08:26,213 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:08:26,214 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:26,214 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:08:26,214 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data null 2023-07-23 15:08:26,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-23 15:08:26,214 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data null 2023-07-23 15:08:26,215 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-23 15:08:26,214 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-23 15:08:26,217 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0a4a68a8fcbff03045cb8a10cb16e91f/cf, FileablePath, hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0a4a68a8fcbff03045cb8a10cb16e91f/recovered.edits] 2023-07-23 15:08:26,218 DEBUG [HFileArchiver-16] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/bbd1a26a126212ba5ef5066fefc2c4f6/cf, FileablePath, hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/bbd1a26a126212ba5ef5066fefc2c4f6/recovered.edits] 2023-07-23 15:08:26,222 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0a4a68a8fcbff03045cb8a10cb16e91f/cf/6efa3c6054004533a0470ac91fac3540 to hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/0a4a68a8fcbff03045cb8a10cb16e91f/cf/6efa3c6054004533a0470ac91fac3540 2023-07-23 15:08:26,223 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/bbd1a26a126212ba5ef5066fefc2c4f6/cf/bf0431f3f08f4cbf80ace843298b5ec3 to hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/bbd1a26a126212ba5ef5066fefc2c4f6/cf/bf0431f3f08f4cbf80ace843298b5ec3 2023-07-23 15:08:26,226 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0a4a68a8fcbff03045cb8a10cb16e91f/recovered.edits/9.seqid to hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/0a4a68a8fcbff03045cb8a10cb16e91f/recovered.edits/9.seqid 2023-07-23 15:08:26,227 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/bbd1a26a126212ba5ef5066fefc2c4f6/recovered.edits/9.seqid to hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/bbd1a26a126212ba5ef5066fefc2c4f6/recovered.edits/9.seqid 2023-07-23 15:08:26,227 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0a4a68a8fcbff03045cb8a10cb16e91f 2023-07-23 15:08:26,228 DEBUG [HFileArchiver-16] backup.HFileArchiver(596): Deleted hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/bbd1a26a126212ba5ef5066fefc2c4f6 2023-07-23 15:08:26,228 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-23 15:08:26,231 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:26,233 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-23 15:08:26,236 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-23 15:08:26,238 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:26,238 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-23 15:08:26,238 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690124886982.0a4a68a8fcbff03045cb8a10cb16e91f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690124906238"}]},"ts":"9223372036854775807"} 2023-07-23 15:08:26,238 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690124886982.bbd1a26a126212ba5ef5066fefc2c4f6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690124906238"}]},"ts":"9223372036854775807"} 2023-07-23 15:08:26,240 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-23 15:08:26,240 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 0a4a68a8fcbff03045cb8a10cb16e91f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1690124886982.0a4a68a8fcbff03045cb8a10cb16e91f.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => bbd1a26a126212ba5ef5066fefc2c4f6, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1690124886982.bbd1a26a126212ba5ef5066fefc2c4f6.', STARTKEY => '1', ENDKEY => ''}] 2023-07-23 15:08:26,240 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-23 15:08:26,240 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690124906240"}]},"ts":"9223372036854775807"} 2023-07-23 15:08:26,241 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-23 15:08:26,244 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:26,245 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 43 msec 2023-07-23 15:08:26,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-23 15:08:26,317 INFO [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-23 15:08:26,335 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-23 15:08:26,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:26,339 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-23 15:08:26,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:26,342 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-23 15:08:26,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:26,378 INFO [Listener at jenkins-hbase4.apache.org/33035] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=761 (was 748) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3d9205bb-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3d9205bb-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-979742745_17 at /127.0.0.1:42712 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3d9205bb-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3d9205bb-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (449583813) connection to jenkins-hbase4.apache.org/172.31.14.131:42831 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x3d9205bb-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3d9205bb-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-979742745_17 at /127.0.0.1:46710 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-979742745_17 at /127.0.0.1:56076 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3949 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_861816563_1 at /127.0.0.1:42668 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_861816563_1 at /127.0.0.1:56044 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=902 (was 898) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=364 (was 277) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 179) - ProcessCount LEAK? -, AvailableMemoryMB=5446 (was 5975) 2023-07-23 15:08:26,379 WARN [Listener at jenkins-hbase4.apache.org/33035] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-23 15:08:26,422 INFO [Listener at jenkins-hbase4.apache.org/33035] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=761, OpenFileDescriptor=902, MaxFileDescriptor=60000, SystemLoadAverage=364, ProcessCount=181, AvailableMemoryMB=5435 2023-07-23 15:08:26,422 WARN [Listener at jenkins-hbase4.apache.org/33035] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-23 15:08:26,424 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-23 15:08:26,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-23 15:08:26,431 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-23 15:08:26,431 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-23 15:08:26,431 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-23 15:08:26,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-23 15:08:26,434 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testEmptyExportFileSystemState/f751b3c7df3c7edc4f27b5cb5916dde6 2023-07-23 15:08:26,435 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testEmptyExportFileSystemState/8f3775937eed563d195bc723e452a409 2023-07-23 15:08:26,435 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testEmptyExportFileSystemState/f751b3c7df3c7edc4f27b5cb5916dde6 empty. 2023-07-23 15:08:26,436 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testEmptyExportFileSystemState/8f3775937eed563d195bc723e452a409 empty. 2023-07-23 15:08:26,436 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testEmptyExportFileSystemState/8f3775937eed563d195bc723e452a409 2023-07-23 15:08:26,436 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testEmptyExportFileSystemState/f751b3c7df3c7edc4f27b5cb5916dde6 2023-07-23 15:08:26,436 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-23 15:08:26,464 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-23 15:08:26,466 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => f751b3c7df3c7edc4f27b5cb5916dde6, NAME => 'testtb-testEmptyExportFileSystemState,,1690124906424.f751b3c7df3c7edc4f27b5cb5916dde6.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp 2023-07-23 15:08:26,467 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 8f3775937eed563d195bc723e452a409, NAME => 'testtb-testEmptyExportFileSystemState,1,1690124906424.8f3775937eed563d195bc723e452a409.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp 2023-07-23 15:08:26,482 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1690124906424.8f3775937eed563d195bc723e452a409.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:08:26,482 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1690124906424.f751b3c7df3c7edc4f27b5cb5916dde6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:08:26,483 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing f751b3c7df3c7edc4f27b5cb5916dde6, disabling compactions & flushes 2023-07-23 15:08:26,483 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1690124906424.f751b3c7df3c7edc4f27b5cb5916dde6. 2023-07-23 15:08:26,483 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1690124906424.f751b3c7df3c7edc4f27b5cb5916dde6. 2023-07-23 15:08:26,483 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1690124906424.f751b3c7df3c7edc4f27b5cb5916dde6. after waiting 0 ms 2023-07-23 15:08:26,482 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 8f3775937eed563d195bc723e452a409, disabling compactions & flushes 2023-07-23 15:08:26,483 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1690124906424.f751b3c7df3c7edc4f27b5cb5916dde6. 2023-07-23 15:08:26,483 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1690124906424.8f3775937eed563d195bc723e452a409. 2023-07-23 15:08:26,483 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1690124906424.f751b3c7df3c7edc4f27b5cb5916dde6. 2023-07-23 15:08:26,483 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1690124906424.8f3775937eed563d195bc723e452a409. 2023-07-23 15:08:26,483 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for f751b3c7df3c7edc4f27b5cb5916dde6: 2023-07-23 15:08:26,483 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1690124906424.8f3775937eed563d195bc723e452a409. after waiting 0 ms 2023-07-23 15:08:26,483 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1690124906424.8f3775937eed563d195bc723e452a409. 2023-07-23 15:08:26,483 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1690124906424.8f3775937eed563d195bc723e452a409. 2023-07-23 15:08:26,484 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 8f3775937eed563d195bc723e452a409: 2023-07-23 15:08:26,487 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-23 15:08:26,488 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1690124906424.f751b3c7df3c7edc4f27b5cb5916dde6.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690124906488"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690124906488"}]},"ts":"1690124906488"} 2023-07-23 15:08:26,488 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1690124906424.8f3775937eed563d195bc723e452a409.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690124906488"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690124906488"}]},"ts":"1690124906488"} 2023-07-23 15:08:26,492 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-23 15:08:26,493 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-23 15:08:26,493 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690124906493"}]},"ts":"1690124906493"} 2023-07-23 15:08:26,496 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-23 15:08:26,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-23 15:08:26,551 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-23 15:08:26,552 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-23 15:08:26,553 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-23 15:08:26,553 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-23 15:08:26,553 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-23 15:08:26,553 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f751b3c7df3c7edc4f27b5cb5916dde6, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8f3775937eed563d195bc723e452a409, ASSIGN}] 2023-07-23 15:08:26,558 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8f3775937eed563d195bc723e452a409, ASSIGN 2023-07-23 15:08:26,558 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f751b3c7df3c7edc4f27b5cb5916dde6, ASSIGN 2023-07-23 15:08:26,559 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8f3775937eed563d195bc723e452a409, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46239,1690124809597; forceNewPlan=false, retain=false 2023-07-23 15:08:26,559 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f751b3c7df3c7edc4f27b5cb5916dde6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46191,1690124809654; forceNewPlan=false, retain=false 2023-07-23 15:08:26,709 INFO [jenkins-hbase4:38379] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-23 15:08:26,712 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=8f3775937eed563d195bc723e452a409, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:26,712 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1690124906424.8f3775937eed563d195bc723e452a409.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690124906712"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690124906712"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690124906712"}]},"ts":"1690124906712"} 2023-07-23 15:08:26,713 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=f751b3c7df3c7edc4f27b5cb5916dde6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:26,713 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1690124906424.f751b3c7df3c7edc4f27b5cb5916dde6.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690124906712"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690124906712"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690124906712"}]},"ts":"1690124906712"} 2023-07-23 15:08:26,718 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure 8f3775937eed563d195bc723e452a409, server=jenkins-hbase4.apache.org,46239,1690124809597}] 2023-07-23 15:08:26,719 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure f751b3c7df3c7edc4f27b5cb5916dde6, server=jenkins-hbase4.apache.org,46191,1690124809654}] 2023-07-23 15:08:26,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-23 15:08:26,876 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1690124906424.f751b3c7df3c7edc4f27b5cb5916dde6. 2023-07-23 15:08:26,876 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1690124906424.8f3775937eed563d195bc723e452a409. 2023-07-23 15:08:26,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f751b3c7df3c7edc4f27b5cb5916dde6, NAME => 'testtb-testEmptyExportFileSystemState,,1690124906424.f751b3c7df3c7edc4f27b5cb5916dde6.', STARTKEY => '', ENDKEY => '1'} 2023-07-23 15:08:26,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8f3775937eed563d195bc723e452a409, NAME => 'testtb-testEmptyExportFileSystemState,1,1690124906424.8f3775937eed563d195bc723e452a409.', STARTKEY => '1', ENDKEY => ''} 2023-07-23 15:08:26,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1690124906424.8f3775937eed563d195bc723e452a409. service=AccessControlService 2023-07-23 15:08:26,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1690124906424.f751b3c7df3c7edc4f27b5cb5916dde6. service=AccessControlService 2023-07-23 15:08:26,876 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 15:08:26,876 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 15:08:26,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 8f3775937eed563d195bc723e452a409 2023-07-23 15:08:26,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState f751b3c7df3c7edc4f27b5cb5916dde6 2023-07-23 15:08:26,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1690124906424.8f3775937eed563d195bc723e452a409.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:08:26,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1690124906424.f751b3c7df3c7edc4f27b5cb5916dde6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:08:26,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8f3775937eed563d195bc723e452a409 2023-07-23 15:08:26,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f751b3c7df3c7edc4f27b5cb5916dde6 2023-07-23 15:08:26,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8f3775937eed563d195bc723e452a409 2023-07-23 15:08:26,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f751b3c7df3c7edc4f27b5cb5916dde6 2023-07-23 15:08:26,878 INFO [StoreOpener-8f3775937eed563d195bc723e452a409-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8f3775937eed563d195bc723e452a409 2023-07-23 15:08:26,878 INFO [StoreOpener-f751b3c7df3c7edc4f27b5cb5916dde6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f751b3c7df3c7edc4f27b5cb5916dde6 2023-07-23 15:08:26,880 DEBUG [StoreOpener-8f3775937eed563d195bc723e452a409-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testEmptyExportFileSystemState/8f3775937eed563d195bc723e452a409/cf 2023-07-23 15:08:26,880 DEBUG [StoreOpener-f751b3c7df3c7edc4f27b5cb5916dde6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testEmptyExportFileSystemState/f751b3c7df3c7edc4f27b5cb5916dde6/cf 2023-07-23 15:08:26,880 DEBUG [StoreOpener-8f3775937eed563d195bc723e452a409-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testEmptyExportFileSystemState/8f3775937eed563d195bc723e452a409/cf 2023-07-23 15:08:26,880 DEBUG [StoreOpener-f751b3c7df3c7edc4f27b5cb5916dde6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testEmptyExportFileSystemState/f751b3c7df3c7edc4f27b5cb5916dde6/cf 2023-07-23 15:08:26,880 INFO [StoreOpener-8f3775937eed563d195bc723e452a409-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8f3775937eed563d195bc723e452a409 columnFamilyName cf 2023-07-23 15:08:26,880 INFO [StoreOpener-f751b3c7df3c7edc4f27b5cb5916dde6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f751b3c7df3c7edc4f27b5cb5916dde6 columnFamilyName cf 2023-07-23 15:08:26,881 INFO [StoreOpener-8f3775937eed563d195bc723e452a409-1] regionserver.HStore(310): Store=8f3775937eed563d195bc723e452a409/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 15:08:26,881 INFO [StoreOpener-f751b3c7df3c7edc4f27b5cb5916dde6-1] regionserver.HStore(310): Store=f751b3c7df3c7edc4f27b5cb5916dde6/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 15:08:26,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testEmptyExportFileSystemState/8f3775937eed563d195bc723e452a409 2023-07-23 15:08:26,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testEmptyExportFileSystemState/f751b3c7df3c7edc4f27b5cb5916dde6 2023-07-23 15:08:26,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testEmptyExportFileSystemState/8f3775937eed563d195bc723e452a409 2023-07-23 15:08:26,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testEmptyExportFileSystemState/f751b3c7df3c7edc4f27b5cb5916dde6 2023-07-23 15:08:26,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f751b3c7df3c7edc4f27b5cb5916dde6 2023-07-23 15:08:26,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8f3775937eed563d195bc723e452a409 2023-07-23 15:08:26,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testEmptyExportFileSystemState/f751b3c7df3c7edc4f27b5cb5916dde6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 15:08:26,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testEmptyExportFileSystemState/8f3775937eed563d195bc723e452a409/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 15:08:26,887 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f751b3c7df3c7edc4f27b5cb5916dde6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62031921, jitterRate=-0.0756523460149765}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 15:08:26,887 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8f3775937eed563d195bc723e452a409; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68025588, jitterRate=0.013660252094268799}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 15:08:26,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f751b3c7df3c7edc4f27b5cb5916dde6: 2023-07-23 15:08:26,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8f3775937eed563d195bc723e452a409: 2023-07-23 15:08:26,887 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1690124906424.8f3775937eed563d195bc723e452a409., pid=93, masterSystemTime=1690124906870 2023-07-23 15:08:26,887 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1690124906424.f751b3c7df3c7edc4f27b5cb5916dde6., pid=94, masterSystemTime=1690124906872 2023-07-23 15:08:26,889 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1690124906424.8f3775937eed563d195bc723e452a409. 2023-07-23 15:08:26,889 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1690124906424.8f3775937eed563d195bc723e452a409. 2023-07-23 15:08:26,889 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=8f3775937eed563d195bc723e452a409, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:26,889 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1690124906424.8f3775937eed563d195bc723e452a409.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690124906889"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690124906889"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690124906889"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690124906889"}]},"ts":"1690124906889"} 2023-07-23 15:08:26,889 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1690124906424.f751b3c7df3c7edc4f27b5cb5916dde6. 2023-07-23 15:08:26,890 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1690124906424.f751b3c7df3c7edc4f27b5cb5916dde6. 2023-07-23 15:08:26,890 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=f751b3c7df3c7edc4f27b5cb5916dde6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:26,890 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1690124906424.f751b3c7df3c7edc4f27b5cb5916dde6.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690124906890"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690124906890"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690124906890"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690124906890"}]},"ts":"1690124906890"} 2023-07-23 15:08:26,892 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=92 2023-07-23 15:08:26,892 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure 8f3775937eed563d195bc723e452a409, server=jenkins-hbase4.apache.org,46239,1690124809597 in 174 msec 2023-07-23 15:08:26,893 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=91 2023-07-23 15:08:26,893 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure f751b3c7df3c7edc4f27b5cb5916dde6, server=jenkins-hbase4.apache.org,46191,1690124809654 in 172 msec 2023-07-23 15:08:26,893 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8f3775937eed563d195bc723e452a409, ASSIGN in 339 msec 2023-07-23 15:08:26,894 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=91, resume processing ppid=90 2023-07-23 15:08:26,894 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f751b3c7df3c7edc4f27b5cb5916dde6, ASSIGN in 340 msec 2023-07-23 15:08:26,895 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-23 15:08:26,895 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690124906895"}]},"ts":"1690124906895"} 2023-07-23 15:08:26,896 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-23 15:08:26,898 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-23 15:08:26,898 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-23 15:08:26,899 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34279] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-23 15:08:26,901 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:08:26,901 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:08:26,901 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:08:26,901 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:08:26,902 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-23 15:08:26,902 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-23 15:08:26,902 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-23 15:08:26,902 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-23 15:08:26,903 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 478 msec 2023-07-23 15:08:27,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-23 15:08:27,038 INFO [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-23 15:08:27,038 DEBUG [Listener at jenkins-hbase4.apache.org/33035] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testEmptyExportFileSystemState get assigned. Timeout = 60000ms 2023-07-23 15:08:27,039 INFO [Listener at jenkins-hbase4.apache.org/33035] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 15:08:27,046 INFO [Listener at jenkins-hbase4.apache.org/33035] hbase.HBaseTestingUtility(3484): All regions for table testtb-testEmptyExportFileSystemState assigned to meta. Checking AM states. 2023-07-23 15:08:27,046 INFO [Listener at jenkins-hbase4.apache.org/33035] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 15:08:27,046 INFO [Listener at jenkins-hbase4.apache.org/33035] hbase.HBaseTestingUtility(3504): All regions for table testtb-testEmptyExportFileSystemState assigned. 2023-07-23 15:08:27,062 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 15:08:27,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690124907062 (current time:1690124907062). 2023-07-23 15:08:27,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 15:08:27,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] zookeeper.ReadOnlyZKClient(139): Connect 0x490323ea to 127.0.0.1:51019 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 15:08:27,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@756d316f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 15:08:27,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:08:27,089 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49182, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:08:27,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x490323ea to 127.0.0.1:51019 2023-07-23 15:08:27,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 15:08:27,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] zookeeper.ReadOnlyZKClient(139): Connect 0x58a225d2 to 127.0.0.1:51019 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 15:08:27,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@8ee415f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 15:08:27,199 DEBUG [hconnection-0x1414ef64-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:08:27,200 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49194, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:08:27,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x58a225d2 to 127.0.0.1:51019 2023-07-23 15:08:27,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 15:08:27,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-23 15:08:27,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 15:08:27,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 15:08:27,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-23 15:08:27,212 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-23 15:08:27,213 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690125507213 2023-07-23 15:08:27,213 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-23 15:08:27,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 15:08:27,214 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 15:08:27,214 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 15:08:27,215 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-23 15:08:27,216 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-23 15:08:27,217 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-23 15:08:27,220 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-23 15:08:27,221 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690125507221 2023-07-23 15:08:27,231 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:27,232 INFO [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-23 15:08:27,232 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:08:27,233 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-23 15:08:27,233 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-23 15:08:27,234 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:27,234 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:27,239 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:27,240 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:27,240 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:27,239 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:27,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:27,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:27,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:27,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:27,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:27,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:27,240 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:27,240 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:27,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:27,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:27,242 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:27,242 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 15:08:27,242 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:27,243 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:27,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-23 15:08:27,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:27,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-23 15:08:27,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:27,243 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-23 15:08:27,243 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-23 15:08:27,243 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:27,243 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-23 15:08:27,243 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:27,243 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:08:27,244 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-23 15:08:27,245 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-23 15:08:27,245 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-23 15:08:27,245 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46239,1690124809597' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-23 15:08:27,245 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:08:27,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:27,246 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-23 15:08:27,246 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-23 15:08:27,246 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46191,1690124809654' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-23 15:08:27,247 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:27,251 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:27,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:27,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:08:27,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:08:27,251 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:27,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-23 15:08:27,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:27,253 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-23 15:08:27,253 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:27,253 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-23 15:08:27,253 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:08:27,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:08:27,253 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:27,253 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:27,257 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:08:27,255 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-23 15:08:27,253 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:27,257 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-23 15:08:27,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:08:27,257 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34279,1690124809505' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-23 15:08:27,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:27,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:27,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:27,258 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:27,258 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:08:27,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:08:27,262 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:27,262 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46239,1690124809597' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-23 15:08:27,262 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5f1cee5a[Count = 1] remaining members to acquire global barrier 2023-07-23 15:08:27,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:27,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:08:27,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:08:27,262 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:27,262 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:08:27,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:08:27,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:08:27,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:27,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:27,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:27,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:27,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:08:27,265 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46191,1690124809654' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-23 15:08:27,265 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5f1cee5a[Count = 0] remaining members to acquire global barrier 2023-07-23 15:08:27,265 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-23 15:08:27,265 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:27,267 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:27,267 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:27,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:27,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:27,267 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:27,267 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-23 15:08:27,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:27,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:27,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:27,267 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-23 15:08:27,267 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:27,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:27,267 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-23 15:08:27,267 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-23 15:08:27,267 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34279,1690124809505' in zk 2023-07-23 15:08:27,267 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:27,268 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 15:08:27,269 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-23 15:08:27,269 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:08:27,269 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-23 15:08:27,278 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 15:08:27,278 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1690124906424.8f3775937eed563d195bc723e452a409. 2023-07-23 15:08:27,278 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 15:08:27,278 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 15:08:27,278 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1690124906424.f751b3c7df3c7edc4f27b5cb5916dde6. 2023-07-23 15:08:27,278 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690124906424.8f3775937eed563d195bc723e452a409. started... 2023-07-23 15:08:27,278 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 15:08:27,279 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690124906424.f751b3c7df3c7edc4f27b5cb5916dde6. started... 2023-07-23 15:08:27,280 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8f3775937eed563d195bc723e452a409: 2023-07-23 15:08:27,281 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f751b3c7df3c7edc4f27b5cb5916dde6: 2023-07-23 15:08:27,281 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1690124906424.8f3775937eed563d195bc723e452a409.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:27,281 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1690124906424.f751b3c7df3c7edc4f27b5cb5916dde6.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:27,281 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 15:08:27,281 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 15:08:27,281 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 15:08:27,281 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 15:08:27,315 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 15:08:27,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 15:08:27,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-23 15:08:27,316 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 15:08:27,517 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 15:08:27,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 15:08:27,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-23 15:08:27,518 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-23 15:08:27,733 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690124906424.f751b3c7df3c7edc4f27b5cb5916dde6. completed. 2023-07-23 15:08:27,733 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1690124906424.f751b3c7df3c7edc4f27b5cb5916dde6. 2023-07-23 15:08:27,733 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 15:08:27,733 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 15:08:27,733 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:27,734 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-23 15:08:27,734 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46191,1690124809654' in zk 2023-07-23 15:08:27,734 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690124906424.8f3775937eed563d195bc723e452a409. completed. 2023-07-23 15:08:27,734 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1690124906424.8f3775937eed563d195bc723e452a409. 2023-07-23 15:08:27,734 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 15:08:27,734 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 15:08:27,734 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:27,734 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-23 15:08:27,734 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46239,1690124809597' in zk 2023-07-23 15:08:27,735 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:27,736 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-23 15:08:27,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:27,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:08:27,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:08:27,736 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:08:27,736 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-23 15:08:27,736 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:27,736 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-23 15:08:27,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:08:27,736 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:08:27,737 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-23 15:08:27,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:08:27,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:27,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:27,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:27,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:27,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:08:27,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:27,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:27,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:27,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:27,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,46191,1690124809654': 2023-07-23 15:08:27,745 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46191,1690124809654' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-23 15:08:27,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:27,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:08:27,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:08:27,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:08:27,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:08:27,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:27,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:27,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:27,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:27,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:08:27,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:27,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:27,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:27,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:27,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,46239,1690124809597': 2023-07-23 15:08:27,750 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46239,1690124809597' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-23 15:08:27,750 INFO [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-23 15:08:27,751 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 15:08:27,751 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 15:08:27,751 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:27,751 INFO [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 15:08:27,753 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:27,753 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:27,753 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:27,753 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:27,753 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:27,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:27,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:08:27,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:08:27,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:27,753 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:27,753 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:27,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:27,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:27,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:27,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:08:27,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:27,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:27,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:27,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:27,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:27,754 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:27,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:27,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:27,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:27,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:27,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:27,755 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:27,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:08:27,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:27,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:27,756 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:27,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:27,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:27,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:27,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:27,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:08:27,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:27,759 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:27,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:27,759 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:27,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:27,760 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:27,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:27,765 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:27,765 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:27,765 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:27,765 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:27,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:27,765 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:27,765 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:27,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:27,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:27,765 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:27,766 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:08:27,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:27,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:27,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:27,765 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:27,769 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:27,766 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:27,769 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:27,769 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:27,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:27,769 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:27,769 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:27,769 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:27,769 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:27,769 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:27,770 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:27,770 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:27,770 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:27,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:27,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:27,770 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:27,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:27,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:27,802 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:27,819 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 15:08:27,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 15:08:27,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-23 15:08:27,822 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-23 15:08:27,825 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-23 15:08:27,825 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:27,825 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:27,826 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1690124907213Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1690124907769 (+556 ms)Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1690124907769Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1690124907781 (+12 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1690124907796 (+15 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1690124907825 (+29 ms) 2023-07-23 15:08:27,830 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-23 15:08:27,831 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 616 msec 2023-07-23 15:08:28,318 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-23 15:08:28,322 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 15:08:28,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 15:08:28,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 15:08:28,329 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46191] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1690124906424.f751b3c7df3c7edc4f27b5cb5916dde6. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 15:08:28,330 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46239] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1690124906424.8f3775937eed563d195bc723e452a409. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 15:08:28,332 DEBUG [Listener at jenkins-hbase4.apache.org/33035] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-23 15:08:28,332 DEBUG [Listener at jenkins-hbase4.apache.org/33035] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1690124906424.f751b3c7df3c7edc4f27b5cb5916dde6. 2023-07-23 15:08:28,332 INFO [Listener at jenkins-hbase4.apache.org/33035] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 15:08:28,342 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 15:08:28,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690124908342 (current time:1690124908342). 2023-07-23 15:08:28,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 15:08:28,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] zookeeper.ReadOnlyZKClient(139): Connect 0x39986d90 to 127.0.0.1:51019 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 15:08:28,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@a44da08, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 15:08:28,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:08:28,352 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49206, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:08:28,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x39986d90 to 127.0.0.1:51019 2023-07-23 15:08:28,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 15:08:28,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] zookeeper.ReadOnlyZKClient(139): Connect 0x6aa09cad to 127.0.0.1:51019 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 15:08:28,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@102e8884, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 15:08:28,362 DEBUG [hconnection-0x3c968413-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:08:28,365 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49210, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:08:28,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6aa09cad to 127.0.0.1:51019 2023-07-23 15:08:28,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 15:08:28,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-23 15:08:28,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 15:08:28,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 15:08:28,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-23 15:08:28,387 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-23 15:08:28,388 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690125508388 2023-07-23 15:08:28,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 15:08:28,388 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-23 15:08:28,392 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 15:08:28,392 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 15:08:28,393 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-23 15:08:28,394 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-23 15:08:28,395 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 14 msec 2023-07-23 15:08:28,396 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-23 15:08:28,397 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690125508397 2023-07-23 15:08:28,408 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,408 INFO [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-23 15:08:28,408 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:08:28,409 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-23 15:08:28,409 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-23 15:08:28,410 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,410 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,411 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:28,411 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:28,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:28,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:28,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:28,411 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:28,411 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:28,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:28,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:28,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:28,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,412 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:28,412 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:28,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,412 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,412 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:28,412 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 15:08:28,412 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,412 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-23 15:08:28,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-23 15:08:28,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,413 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-23 15:08:28,413 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-23 15:08:28,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-23 15:08:28,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,413 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,413 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-23 15:08:28,413 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-23 15:08:28,413 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:08:28,415 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-23 15:08:28,415 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,416 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-23 15:08:28,416 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:08:28,415 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,415 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-23 15:08:28,417 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-23 15:08:28,417 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:08:28,417 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-23 15:08:28,420 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-23 15:08:28,420 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-23 15:08:28,417 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46191,1690124809654' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-23 15:08:28,420 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34279,1690124809505' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-23 15:08:28,420 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-23 15:08:28,420 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46239,1690124809597' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-23 15:08:28,421 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:28,421 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:28,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:08:28,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:08:28,422 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,422 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:28,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:08:28,422 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,422 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,422 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:08:28,422 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,422 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:08:28,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:08:28,422 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,423 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:08:28,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:28,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:28,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:28,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:08:28,424 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46191,1690124809654' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-23 15:08:28,424 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@67ac1631[Count = 1] remaining members to acquire global barrier 2023-07-23 15:08:28,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:28,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:08:28,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:08:28,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:08:28,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:08:28,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:28,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:28,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:28,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:08:28,426 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46239,1690124809597' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-23 15:08:28,426 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@67ac1631[Count = 0] remaining members to acquire global barrier 2023-07-23 15:08:28,426 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-23 15:08:28,427 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,432 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,432 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,432 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,433 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:28,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,433 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-23 15:08:28,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,433 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-23 15:08:28,433 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:28,433 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-23 15:08:28,433 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-23 15:08:28,433 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34279,1690124809505' in zk 2023-07-23 15:08:28,433 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 15:08:28,433 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 15:08:28,433 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1690124906424.8f3775937eed563d195bc723e452a409. 2023-07-23 15:08:28,433 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 15:08:28,433 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 15:08:28,433 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 15:08:28,433 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1690124906424.f751b3c7df3c7edc4f27b5cb5916dde6. 2023-07-23 15:08:28,433 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690124906424.8f3775937eed563d195bc723e452a409. started... 2023-07-23 15:08:28,434 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690124906424.f751b3c7df3c7edc4f27b5cb5916dde6. started... 2023-07-23 15:08:28,434 INFO [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f751b3c7df3c7edc4f27b5cb5916dde6 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-23 15:08:28,434 INFO [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 8f3775937eed563d195bc723e452a409 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-23 15:08:28,435 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-23 15:08:28,435 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:08:28,435 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-23 15:08:28,451 INFO [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testEmptyExportFileSystemState/f751b3c7df3c7edc4f27b5cb5916dde6/.tmp/cf/1bc0d417b0aa420ab7a09a467006f634 2023-07-23 15:08:28,451 INFO [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testEmptyExportFileSystemState/8f3775937eed563d195bc723e452a409/.tmp/cf/599c39d9b34140f0abaea3b2eb302e53 2023-07-23 15:08:28,458 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testEmptyExportFileSystemState/f751b3c7df3c7edc4f27b5cb5916dde6/.tmp/cf/1bc0d417b0aa420ab7a09a467006f634 as hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testEmptyExportFileSystemState/f751b3c7df3c7edc4f27b5cb5916dde6/cf/1bc0d417b0aa420ab7a09a467006f634 2023-07-23 15:08:28,458 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testEmptyExportFileSystemState/8f3775937eed563d195bc723e452a409/.tmp/cf/599c39d9b34140f0abaea3b2eb302e53 as hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testEmptyExportFileSystemState/8f3775937eed563d195bc723e452a409/cf/599c39d9b34140f0abaea3b2eb302e53 2023-07-23 15:08:28,463 INFO [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testEmptyExportFileSystemState/8f3775937eed563d195bc723e452a409/cf/599c39d9b34140f0abaea3b2eb302e53, entries=47, sequenceid=6, filesize=8 K 2023-07-23 15:08:28,463 INFO [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testEmptyExportFileSystemState/f751b3c7df3c7edc4f27b5cb5916dde6/cf/1bc0d417b0aa420ab7a09a467006f634, entries=3, sequenceid=6, filesize=5.0 K 2023-07-23 15:08:28,464 INFO [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 8f3775937eed563d195bc723e452a409 in 30ms, sequenceid=6, compaction requested=false 2023-07-23 15:08:28,465 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8f3775937eed563d195bc723e452a409: 2023-07-23 15:08:28,465 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1690124906424.8f3775937eed563d195bc723e452a409.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,465 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 15:08:28,465 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testEmptyExportFileSystemState/8f3775937eed563d195bc723e452a409/cf/599c39d9b34140f0abaea3b2eb302e53] hfiles 2023-07-23 15:08:28,465 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testEmptyExportFileSystemState/8f3775937eed563d195bc723e452a409/cf/599c39d9b34140f0abaea3b2eb302e53 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,466 INFO [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for f751b3c7df3c7edc4f27b5cb5916dde6 in 32ms, sequenceid=6, compaction requested=false 2023-07-23 15:08:28,466 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f751b3c7df3c7edc4f27b5cb5916dde6: 2023-07-23 15:08:28,466 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1690124906424.f751b3c7df3c7edc4f27b5cb5916dde6.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,466 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 15:08:28,466 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testEmptyExportFileSystemState/f751b3c7df3c7edc4f27b5cb5916dde6/cf/1bc0d417b0aa420ab7a09a467006f634] hfiles 2023-07-23 15:08:28,466 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testEmptyExportFileSystemState/f751b3c7df3c7edc4f27b5cb5916dde6/cf/1bc0d417b0aa420ab7a09a467006f634 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,476 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690124906424.f751b3c7df3c7edc4f27b5cb5916dde6. completed. 2023-07-23 15:08:28,476 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1690124906424.f751b3c7df3c7edc4f27b5cb5916dde6. 2023-07-23 15:08:28,476 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 15:08:28,476 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 15:08:28,476 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:28,476 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-23 15:08:28,477 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46191,1690124809654' in zk 2023-07-23 15:08:28,478 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690124906424.8f3775937eed563d195bc723e452a409. completed. 2023-07-23 15:08:28,478 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1690124906424.8f3775937eed563d195bc723e452a409. 2023-07-23 15:08:28,478 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 15:08:28,478 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-23 15:08:28,478 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 15:08:28,478 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:28,478 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:28,478 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-23 15:08:28,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:28,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:08:28,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:08:28,478 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:08:28,478 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46239,1690124809597' in zk 2023-07-23 15:08:28,479 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-23 15:08:28,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:08:28,481 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:28,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:08:28,481 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-23 15:08:28,481 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:08:28,481 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-23 15:08:28,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:28,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:28,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:28,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:08:28,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:28,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:28,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:28,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,46191,1690124809654': 2023-07-23 15:08:28,485 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46191,1690124809654' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-23 15:08:28,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:28,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:08:28,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:08:28,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:08:28,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:08:28,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:28,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:28,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:28,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:08:28,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:28,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:28,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:28,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,46239,1690124809597': 2023-07-23 15:08:28,489 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46239,1690124809597' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-23 15:08:28,489 INFO [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-23 15:08:28,489 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 15:08:28,489 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 15:08:28,489 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,489 INFO [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 15:08:28,491 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,492 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,492 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,492 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:28,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:08:28,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:08:28,492 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,492 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:28,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,492 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:28,492 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:28,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:28,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:28,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:28,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:28,492 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 15:08:28,493 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:28,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:08:28,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:28,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,493 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:28,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:28,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 15:08:28,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-23 15:08:28,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,494 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 15:08:28,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:08:28,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:28,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:28,495 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:28,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:28,496 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:28,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:08:28,496 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:28,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:28,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:28,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:28,499 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:28,499 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,499 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:28,499 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:28,499 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,499 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:28,499 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:28,499 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:28,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:28,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:28,499 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:28,499 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:28,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:28,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:28,499 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:28,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:28,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:28,499 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,499 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,499 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:08:28,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:28,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:28,499 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:28,499 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:28,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:28,499 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:28,500 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:28,500 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,500 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,500 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:28,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:28,521 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,547 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-23 15:08:28,547 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,548 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,548 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1690124908388Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1690124908499 (+111 ms)Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1690124908500 (+1 ms)Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1690124908506 (+6 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1690124908515 (+9 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1690124908547 (+32 ms) 2023-07-23 15:08:28,554 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-23 15:08:28,558 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 165 msec 2023-07-23 15:08:28,694 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 15:08:28,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 15:08:28,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 15:08:28,696 INFO [Listener at jenkins-hbase4.apache.org/33035] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/export-test/export-1690124908696 2023-07-23 15:08:28,696 INFO [Listener at jenkins-hbase4.apache.org/33035] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:45535, tgtDir=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/export-test/export-1690124908696, rawTgtDir=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/export-test/export-1690124908696, srcFsUri=hdfs://localhost:45535, srcDir=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40 2023-07-23 15:08:28,726 DEBUG [Listener at jenkins-hbase4.apache.org/33035] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45535, inputRoot=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40 2023-07-23 15:08:28,726 DEBUG [Listener at jenkins-hbase4.apache.org/33035] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_211799027_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/export-test/export-1690124908696, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/export-test/export-1690124908696/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,726 INFO [Listener at jenkins-hbase4.apache.org/33035] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45535, inputRoot=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40, snapshotDir=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-23 15:08:28,740 INFO [Listener at jenkins-hbase4.apache.org/33035] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/export-test/export-1690124908696/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,830 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:28,830 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:28,831 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:28,831 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:28,831 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:28,832 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:28,832 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:28,908 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/hadoop-7913985445582454199.jar 2023-07-23 15:08:28,909 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:28,910 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:28,910 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:28,911 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:28,911 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:28,911 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:28,912 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-23 15:08:28,913 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-23 15:08:28,919 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-23 15:08:28,920 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-23 15:08:28,920 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-23 15:08:28,921 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-23 15:08:28,921 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-23 15:08:28,922 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-23 15:08:28,922 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-23 15:08:28,923 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-23 15:08:28,924 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 15:08:28,924 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 15:08:28,925 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 15:08:28,925 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 15:08:28,925 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 15:08:28,926 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 15:08:28,926 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 15:08:29,626 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690124817489_0005_000001 (auth:SIMPLE) 2023-07-23 15:08:30,100 WARN [Listener at jenkins-hbase4.apache.org/33035] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-23 15:08:30,104 INFO [Listener at jenkins-hbase4.apache.org/33035] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-23 15:08:30,259 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 15:08:30,259 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 15:08:30,628 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690124817489_0006_000001 (auth:SIMPLE) 2023-07-23 15:08:31,280 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-23 15:08:36,817 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690124817489_0006_000001 (auth:SIMPLE) 2023-07-23 15:08:39,401 INFO [Listener at jenkins-hbase4.apache.org/33035] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-23 15:08:39,402 INFO [Listener at jenkins-hbase4.apache.org/33035] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-23 15:08:39,416 INFO [Listener at jenkins-hbase4.apache.org/33035] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:39,416 INFO [Listener at jenkins-hbase4.apache.org/33035] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-23 15:08:39,417 INFO [Listener at jenkins-hbase4.apache.org/33035] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-23 15:08:39,417 DEBUG [Listener at jenkins-hbase4.apache.org/33035] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-979742745_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:39,418 DEBUG [Listener at jenkins-hbase4.apache.org/33035] snapshot.TestExportSnapshot(367): hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-23 15:08:39,418 DEBUG [Listener at jenkins-hbase4.apache.org/33035] snapshot.TestExportSnapshot(367): hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-23 15:08:39,418 DEBUG [Listener at jenkins-hbase4.apache.org/33035] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-979742745_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/export-test/export-1690124908696/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/export-test/export-1690124908696/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:39,419 DEBUG [Listener at jenkins-hbase4.apache.org/33035] snapshot.TestExportSnapshot(367): hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/export-test/export-1690124908696/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-23 15:08:39,419 DEBUG [Listener at jenkins-hbase4.apache.org/33035] snapshot.TestExportSnapshot(367): hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/export-test/export-1690124908696/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-23 15:08:39,427 INFO [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-23 15:08:39,428 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-23 15:08:39,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-23 15:08:39,433 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690124919433"}]},"ts":"1690124919433"} 2023-07-23 15:08:39,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-23 15:08:39,436 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-23 15:08:39,438 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-23 15:08:39,438 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f751b3c7df3c7edc4f27b5cb5916dde6, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8f3775937eed563d195bc723e452a409, UNASSIGN}] 2023-07-23 15:08:39,439 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f751b3c7df3c7edc4f27b5cb5916dde6, UNASSIGN 2023-07-23 15:08:39,441 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8f3775937eed563d195bc723e452a409, UNASSIGN 2023-07-23 15:08:39,443 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=8f3775937eed563d195bc723e452a409, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:39,443 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=f751b3c7df3c7edc4f27b5cb5916dde6, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:39,443 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1690124906424.8f3775937eed563d195bc723e452a409.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690124919443"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690124919443"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690124919443"}]},"ts":"1690124919443"} 2023-07-23 15:08:39,443 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1690124906424.f751b3c7df3c7edc4f27b5cb5916dde6.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690124919443"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690124919443"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690124919443"}]},"ts":"1690124919443"} 2023-07-23 15:08:39,447 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=101, state=RUNNABLE; CloseRegionProcedure 8f3775937eed563d195bc723e452a409, server=jenkins-hbase4.apache.org,46239,1690124809597}] 2023-07-23 15:08:39,452 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; CloseRegionProcedure f751b3c7df3c7edc4f27b5cb5916dde6, server=jenkins-hbase4.apache.org,46191,1690124809654}] 2023-07-23 15:08:39,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-23 15:08:39,603 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 8f3775937eed563d195bc723e452a409 2023-07-23 15:08:39,603 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8f3775937eed563d195bc723e452a409, disabling compactions & flushes 2023-07-23 15:08:39,603 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1690124906424.8f3775937eed563d195bc723e452a409. 2023-07-23 15:08:39,603 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1690124906424.8f3775937eed563d195bc723e452a409. 2023-07-23 15:08:39,603 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1690124906424.8f3775937eed563d195bc723e452a409. after waiting 0 ms 2023-07-23 15:08:39,603 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1690124906424.8f3775937eed563d195bc723e452a409. 2023-07-23 15:08:39,604 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f751b3c7df3c7edc4f27b5cb5916dde6 2023-07-23 15:08:39,604 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f751b3c7df3c7edc4f27b5cb5916dde6, disabling compactions & flushes 2023-07-23 15:08:39,606 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1690124906424.f751b3c7df3c7edc4f27b5cb5916dde6. 2023-07-23 15:08:39,606 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1690124906424.f751b3c7df3c7edc4f27b5cb5916dde6. 2023-07-23 15:08:39,606 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1690124906424.f751b3c7df3c7edc4f27b5cb5916dde6. after waiting 0 ms 2023-07-23 15:08:39,606 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1690124906424.f751b3c7df3c7edc4f27b5cb5916dde6. 2023-07-23 15:08:39,631 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testEmptyExportFileSystemState/8f3775937eed563d195bc723e452a409/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 15:08:39,631 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testEmptyExportFileSystemState/f751b3c7df3c7edc4f27b5cb5916dde6/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 15:08:39,632 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 15:08:39,632 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 15:08:39,633 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1690124906424.8f3775937eed563d195bc723e452a409. 2023-07-23 15:08:39,633 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8f3775937eed563d195bc723e452a409: 2023-07-23 15:08:39,635 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1690124906424.f751b3c7df3c7edc4f27b5cb5916dde6. 2023-07-23 15:08:39,635 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f751b3c7df3c7edc4f27b5cb5916dde6: 2023-07-23 15:08:39,636 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 8f3775937eed563d195bc723e452a409 2023-07-23 15:08:39,637 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=8f3775937eed563d195bc723e452a409, regionState=CLOSED 2023-07-23 15:08:39,637 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1690124906424.8f3775937eed563d195bc723e452a409.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690124919637"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690124919637"}]},"ts":"1690124919637"} 2023-07-23 15:08:39,637 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f751b3c7df3c7edc4f27b5cb5916dde6 2023-07-23 15:08:39,639 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=f751b3c7df3c7edc4f27b5cb5916dde6, regionState=CLOSED 2023-07-23 15:08:39,639 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1690124906424.f751b3c7df3c7edc4f27b5cb5916dde6.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690124919639"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690124919639"}]},"ts":"1690124919639"} 2023-07-23 15:08:39,641 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=101 2023-07-23 15:08:39,641 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=101, state=SUCCESS; CloseRegionProcedure 8f3775937eed563d195bc723e452a409, server=jenkins-hbase4.apache.org,46239,1690124809597 in 192 msec 2023-07-23 15:08:39,644 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=100 2023-07-23 15:08:39,644 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=100, state=SUCCESS; CloseRegionProcedure f751b3c7df3c7edc4f27b5cb5916dde6, server=jenkins-hbase4.apache.org,46191,1690124809654 in 189 msec 2023-07-23 15:08:39,645 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8f3775937eed563d195bc723e452a409, UNASSIGN in 203 msec 2023-07-23 15:08:39,650 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=100, resume processing ppid=99 2023-07-23 15:08:39,650 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f751b3c7df3c7edc4f27b5cb5916dde6, UNASSIGN in 206 msec 2023-07-23 15:08:39,651 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690124919651"}]},"ts":"1690124919651"} 2023-07-23 15:08:39,653 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-23 15:08:39,654 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-23 15:08:39,656 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 227 msec 2023-07-23 15:08:39,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-23 15:08:39,736 INFO [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-23 15:08:39,737 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-23 15:08:39,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-23 15:08:39,740 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-23 15:08:39,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-23 15:08:39,741 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-23 15:08:39,743 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34279] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-23 15:08:39,745 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-23 15:08:39,745 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-23 15:08:39,745 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-23 15:08:39,745 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-23 15:08:39,746 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-23 15:08:39,746 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-23 15:08:39,746 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-23 15:08:39,746 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testEmptyExportFileSystemState/8f3775937eed563d195bc723e452a409 2023-07-23 15:08:39,746 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testEmptyExportFileSystemState/f751b3c7df3c7edc4f27b5cb5916dde6 2023-07-23 15:08:39,747 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-23 15:08:39,747 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:08:39,747 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-23 15:08:39,747 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-23 15:08:39,747 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data null 2023-07-23 15:08:39,747 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:08:39,747 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:08:39,747 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-23 15:08:39,747 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:08:39,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-23 15:08:39,748 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testEmptyExportFileSystemState/f751b3c7df3c7edc4f27b5cb5916dde6/cf, FileablePath, hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testEmptyExportFileSystemState/f751b3c7df3c7edc4f27b5cb5916dde6/recovered.edits] 2023-07-23 15:08:39,748 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testEmptyExportFileSystemState/8f3775937eed563d195bc723e452a409/cf, FileablePath, hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testEmptyExportFileSystemState/8f3775937eed563d195bc723e452a409/recovered.edits] 2023-07-23 15:08:39,752 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testEmptyExportFileSystemState/f751b3c7df3c7edc4f27b5cb5916dde6/cf/1bc0d417b0aa420ab7a09a467006f634 to hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/archive/data/default/testtb-testEmptyExportFileSystemState/f751b3c7df3c7edc4f27b5cb5916dde6/cf/1bc0d417b0aa420ab7a09a467006f634 2023-07-23 15:08:39,753 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testEmptyExportFileSystemState/8f3775937eed563d195bc723e452a409/cf/599c39d9b34140f0abaea3b2eb302e53 to hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/archive/data/default/testtb-testEmptyExportFileSystemState/8f3775937eed563d195bc723e452a409/cf/599c39d9b34140f0abaea3b2eb302e53 2023-07-23 15:08:39,756 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testEmptyExportFileSystemState/f751b3c7df3c7edc4f27b5cb5916dde6/recovered.edits/9.seqid to hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/archive/data/default/testtb-testEmptyExportFileSystemState/f751b3c7df3c7edc4f27b5cb5916dde6/recovered.edits/9.seqid 2023-07-23 15:08:39,756 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testEmptyExportFileSystemState/8f3775937eed563d195bc723e452a409/recovered.edits/9.seqid to hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/archive/data/default/testtb-testEmptyExportFileSystemState/8f3775937eed563d195bc723e452a409/recovered.edits/9.seqid 2023-07-23 15:08:39,757 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testEmptyExportFileSystemState/f751b3c7df3c7edc4f27b5cb5916dde6 2023-07-23 15:08:39,757 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testEmptyExportFileSystemState/8f3775937eed563d195bc723e452a409 2023-07-23 15:08:39,757 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-23 15:08:39,759 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-23 15:08:39,761 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-23 15:08:39,763 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-23 15:08:39,764 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-23 15:08:39,764 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-23 15:08:39,764 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1690124906424.f751b3c7df3c7edc4f27b5cb5916dde6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690124919764"}]},"ts":"9223372036854775807"} 2023-07-23 15:08:39,764 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1690124906424.8f3775937eed563d195bc723e452a409.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690124919764"}]},"ts":"9223372036854775807"} 2023-07-23 15:08:39,766 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-23 15:08:39,766 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => f751b3c7df3c7edc4f27b5cb5916dde6, NAME => 'testtb-testEmptyExportFileSystemState,,1690124906424.f751b3c7df3c7edc4f27b5cb5916dde6.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 8f3775937eed563d195bc723e452a409, NAME => 'testtb-testEmptyExportFileSystemState,1,1690124906424.8f3775937eed563d195bc723e452a409.', STARTKEY => '1', ENDKEY => ''}] 2023-07-23 15:08:39,766 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-23 15:08:39,766 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690124919766"}]},"ts":"9223372036854775807"} 2023-07-23 15:08:39,767 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-23 15:08:39,769 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-23 15:08:39,770 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 32 msec 2023-07-23 15:08:39,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-23 15:08:39,850 INFO [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-23 15:08:39,856 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-23 15:08:39,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:39,859 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-23 15:08:39,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:39,886 INFO [Listener at jenkins-hbase4.apache.org/33035] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=764 (was 761) Potentially hanging thread: hconnection-0x3d9205bb-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3d9205bb-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (449583813) connection to jenkins-hbase4.apache.org/172.31.14.131:39001 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2043715433_1 at /127.0.0.1:34000 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3d9205bb-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4601 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-979742745_17 at /127.0.0.1:34022 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2043715433_1 at /127.0.0.1:49522 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-979742745_17 at /127.0.0.1:43292 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (449583813) connection to jenkins-hbase4.apache.org/172.31.14.131:45373 from appattempt_1690124817489_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3d9205bb-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (449583813) connection to jenkins-hbase4.apache.org/172.31.14.131:40499 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=919 (was 902) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=446 (was 364) - SystemLoadAverage LEAK? -, ProcessCount=180 (was 181), AvailableMemoryMB=5719 (was 5435) - AvailableMemoryMB LEAK? - 2023-07-23 15:08:39,886 WARN [Listener at jenkins-hbase4.apache.org/33035] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-07-23 15:08:39,910 INFO [Listener at jenkins-hbase4.apache.org/33035] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=764, OpenFileDescriptor=919, MaxFileDescriptor=60000, SystemLoadAverage=446, ProcessCount=180, AvailableMemoryMB=5717 2023-07-23 15:08:39,910 WARN [Listener at jenkins-hbase4.apache.org/33035] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-07-23 15:08:39,912 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-23 15:08:39,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:39,916 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-23 15:08:39,916 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-23 15:08:39,916 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-23 15:08:39,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-23 15:08:39,918 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e3aeb5c28430d5dd4b5d6066c4fb4830 2023-07-23 15:08:39,918 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/482ac59b1076b7a548733971ddd85e5e 2023-07-23 15:08:39,919 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e3aeb5c28430d5dd4b5d6066c4fb4830 empty. 2023-07-23 15:08:39,919 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/482ac59b1076b7a548733971ddd85e5e empty. 2023-07-23 15:08:39,919 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e3aeb5c28430d5dd4b5d6066c4fb4830 2023-07-23 15:08:39,919 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/482ac59b1076b7a548733971ddd85e5e 2023-07-23 15:08:39,919 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-23 15:08:39,929 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-23 15:08:39,930 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => e3aeb5c28430d5dd4b5d6066c4fb4830, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1690124919912.e3aeb5c28430d5dd4b5d6066c4fb4830.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp 2023-07-23 15:08:39,931 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 482ac59b1076b7a548733971ddd85e5e, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1690124919912.482ac59b1076b7a548733971ddd85e5e.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp 2023-07-23 15:08:39,951 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1690124919912.482ac59b1076b7a548733971ddd85e5e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:08:39,951 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 482ac59b1076b7a548733971ddd85e5e, disabling compactions & flushes 2023-07-23 15:08:39,952 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1690124919912.482ac59b1076b7a548733971ddd85e5e. 2023-07-23 15:08:39,952 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690124919912.482ac59b1076b7a548733971ddd85e5e. 2023-07-23 15:08:39,952 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690124919912.482ac59b1076b7a548733971ddd85e5e. after waiting 0 ms 2023-07-23 15:08:39,952 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1690124919912.482ac59b1076b7a548733971ddd85e5e. 2023-07-23 15:08:39,952 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1690124919912.482ac59b1076b7a548733971ddd85e5e. 2023-07-23 15:08:39,952 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 482ac59b1076b7a548733971ddd85e5e: 2023-07-23 15:08:40,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-23 15:08:40,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-23 15:08:40,354 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1690124919912.e3aeb5c28430d5dd4b5d6066c4fb4830.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:08:40,354 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing e3aeb5c28430d5dd4b5d6066c4fb4830, disabling compactions & flushes 2023-07-23 15:08:40,354 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1690124919912.e3aeb5c28430d5dd4b5d6066c4fb4830. 2023-07-23 15:08:40,354 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690124919912.e3aeb5c28430d5dd4b5d6066c4fb4830. 2023-07-23 15:08:40,354 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690124919912.e3aeb5c28430d5dd4b5d6066c4fb4830. after waiting 0 ms 2023-07-23 15:08:40,354 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1690124919912.e3aeb5c28430d5dd4b5d6066c4fb4830. 2023-07-23 15:08:40,354 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1690124919912.e3aeb5c28430d5dd4b5d6066c4fb4830. 2023-07-23 15:08:40,354 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for e3aeb5c28430d5dd4b5d6066c4fb4830: 2023-07-23 15:08:40,356 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-23 15:08:40,358 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690124919912.482ac59b1076b7a548733971ddd85e5e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690124920357"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690124920357"}]},"ts":"1690124920357"} 2023-07-23 15:08:40,358 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690124919912.e3aeb5c28430d5dd4b5d6066c4fb4830.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690124920357"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690124920357"}]},"ts":"1690124920357"} 2023-07-23 15:08:40,361 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-23 15:08:40,362 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-23 15:08:40,362 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690124920362"}]},"ts":"1690124920362"} 2023-07-23 15:08:40,363 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-23 15:08:40,366 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-23 15:08:40,367 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-23 15:08:40,367 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-23 15:08:40,368 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-23 15:08:40,368 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-23 15:08:40,368 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e3aeb5c28430d5dd4b5d6066c4fb4830, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=482ac59b1076b7a548733971ddd85e5e, ASSIGN}] 2023-07-23 15:08:40,372 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=482ac59b1076b7a548733971ddd85e5e, ASSIGN 2023-07-23 15:08:40,372 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e3aeb5c28430d5dd4b5d6066c4fb4830, ASSIGN 2023-07-23 15:08:40,372 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=482ac59b1076b7a548733971ddd85e5e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46191,1690124809654; forceNewPlan=false, retain=false 2023-07-23 15:08:40,373 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e3aeb5c28430d5dd4b5d6066c4fb4830, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46239,1690124809597; forceNewPlan=false, retain=false 2023-07-23 15:08:40,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-23 15:08:40,523 INFO [jenkins-hbase4:38379] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-23 15:08:40,526 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=482ac59b1076b7a548733971ddd85e5e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:40,526 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=e3aeb5c28430d5dd4b5d6066c4fb4830, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:40,526 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690124919912.482ac59b1076b7a548733971ddd85e5e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690124920526"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690124920526"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690124920526"}]},"ts":"1690124920526"} 2023-07-23 15:08:40,526 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690124919912.e3aeb5c28430d5dd4b5d6066c4fb4830.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690124920526"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690124920526"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690124920526"}]},"ts":"1690124920526"} 2023-07-23 15:08:40,528 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure 482ac59b1076b7a548733971ddd85e5e, server=jenkins-hbase4.apache.org,46191,1690124809654}] 2023-07-23 15:08:40,529 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure e3aeb5c28430d5dd4b5d6066c4fb4830, server=jenkins-hbase4.apache.org,46239,1690124809597}] 2023-07-23 15:08:40,684 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1690124919912.482ac59b1076b7a548733971ddd85e5e. 2023-07-23 15:08:40,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 482ac59b1076b7a548733971ddd85e5e, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1690124919912.482ac59b1076b7a548733971ddd85e5e.', STARTKEY => '1', ENDKEY => ''} 2023-07-23 15:08:40,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1690124919912.482ac59b1076b7a548733971ddd85e5e. service=AccessControlService 2023-07-23 15:08:40,684 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 15:08:40,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 482ac59b1076b7a548733971ddd85e5e 2023-07-23 15:08:40,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1690124919912.482ac59b1076b7a548733971ddd85e5e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:08:40,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 482ac59b1076b7a548733971ddd85e5e 2023-07-23 15:08:40,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 482ac59b1076b7a548733971ddd85e5e 2023-07-23 15:08:40,685 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1690124919912.e3aeb5c28430d5dd4b5d6066c4fb4830. 2023-07-23 15:08:40,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e3aeb5c28430d5dd4b5d6066c4fb4830, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1690124919912.e3aeb5c28430d5dd4b5d6066c4fb4830.', STARTKEY => '', ENDKEY => '1'} 2023-07-23 15:08:40,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1690124919912.e3aeb5c28430d5dd4b5d6066c4fb4830. service=AccessControlService 2023-07-23 15:08:40,686 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 15:08:40,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp e3aeb5c28430d5dd4b5d6066c4fb4830 2023-07-23 15:08:40,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1690124919912.e3aeb5c28430d5dd4b5d6066c4fb4830.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:08:40,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e3aeb5c28430d5dd4b5d6066c4fb4830 2023-07-23 15:08:40,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e3aeb5c28430d5dd4b5d6066c4fb4830 2023-07-23 15:08:40,687 INFO [StoreOpener-482ac59b1076b7a548733971ddd85e5e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 482ac59b1076b7a548733971ddd85e5e 2023-07-23 15:08:40,688 INFO [StoreOpener-e3aeb5c28430d5dd4b5d6066c4fb4830-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e3aeb5c28430d5dd4b5d6066c4fb4830 2023-07-23 15:08:40,688 DEBUG [StoreOpener-482ac59b1076b7a548733971ddd85e5e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithSkipTmp/482ac59b1076b7a548733971ddd85e5e/cf 2023-07-23 15:08:40,688 DEBUG [StoreOpener-482ac59b1076b7a548733971ddd85e5e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithSkipTmp/482ac59b1076b7a548733971ddd85e5e/cf 2023-07-23 15:08:40,689 INFO [StoreOpener-482ac59b1076b7a548733971ddd85e5e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 482ac59b1076b7a548733971ddd85e5e columnFamilyName cf 2023-07-23 15:08:40,689 DEBUG [StoreOpener-e3aeb5c28430d5dd4b5d6066c4fb4830-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithSkipTmp/e3aeb5c28430d5dd4b5d6066c4fb4830/cf 2023-07-23 15:08:40,689 DEBUG [StoreOpener-e3aeb5c28430d5dd4b5d6066c4fb4830-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithSkipTmp/e3aeb5c28430d5dd4b5d6066c4fb4830/cf 2023-07-23 15:08:40,690 INFO [StoreOpener-482ac59b1076b7a548733971ddd85e5e-1] regionserver.HStore(310): Store=482ac59b1076b7a548733971ddd85e5e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 15:08:40,690 INFO [StoreOpener-e3aeb5c28430d5dd4b5d6066c4fb4830-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e3aeb5c28430d5dd4b5d6066c4fb4830 columnFamilyName cf 2023-07-23 15:08:40,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithSkipTmp/482ac59b1076b7a548733971ddd85e5e 2023-07-23 15:08:40,695 INFO [StoreOpener-e3aeb5c28430d5dd4b5d6066c4fb4830-1] regionserver.HStore(310): Store=e3aeb5c28430d5dd4b5d6066c4fb4830/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 15:08:40,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithSkipTmp/482ac59b1076b7a548733971ddd85e5e 2023-07-23 15:08:40,696 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithSkipTmp/e3aeb5c28430d5dd4b5d6066c4fb4830 2023-07-23 15:08:40,696 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithSkipTmp/e3aeb5c28430d5dd4b5d6066c4fb4830 2023-07-23 15:08:40,699 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 482ac59b1076b7a548733971ddd85e5e 2023-07-23 15:08:40,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithSkipTmp/482ac59b1076b7a548733971ddd85e5e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 15:08:40,702 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 482ac59b1076b7a548733971ddd85e5e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70583610, jitterRate=0.05177775025367737}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 15:08:40,702 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 482ac59b1076b7a548733971ddd85e5e: 2023-07-23 15:08:40,703 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1690124919912.482ac59b1076b7a548733971ddd85e5e., pid=108, masterSystemTime=1690124920680 2023-07-23 15:08:40,704 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e3aeb5c28430d5dd4b5d6066c4fb4830 2023-07-23 15:08:40,704 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1690124919912.482ac59b1076b7a548733971ddd85e5e. 2023-07-23 15:08:40,705 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1690124919912.482ac59b1076b7a548733971ddd85e5e. 2023-07-23 15:08:40,705 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=482ac59b1076b7a548733971ddd85e5e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:40,705 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690124919912.482ac59b1076b7a548733971ddd85e5e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690124920705"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690124920705"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690124920705"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690124920705"}]},"ts":"1690124920705"} 2023-07-23 15:08:40,707 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithSkipTmp/e3aeb5c28430d5dd4b5d6066c4fb4830/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 15:08:40,708 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e3aeb5c28430d5dd4b5d6066c4fb4830; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60727923, jitterRate=-0.09508343040943146}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 15:08:40,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e3aeb5c28430d5dd4b5d6066c4fb4830: 2023-07-23 15:08:40,708 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1690124919912.e3aeb5c28430d5dd4b5d6066c4fb4830., pid=109, masterSystemTime=1690124920681 2023-07-23 15:08:40,708 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=107 2023-07-23 15:08:40,708 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure 482ac59b1076b7a548733971ddd85e5e, server=jenkins-hbase4.apache.org,46191,1690124809654 in 179 msec 2023-07-23 15:08:40,711 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=482ac59b1076b7a548733971ddd85e5e, ASSIGN in 340 msec 2023-07-23 15:08:40,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1690124919912.e3aeb5c28430d5dd4b5d6066c4fb4830. 2023-07-23 15:08:40,711 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1690124919912.e3aeb5c28430d5dd4b5d6066c4fb4830. 2023-07-23 15:08:40,711 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=e3aeb5c28430d5dd4b5d6066c4fb4830, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:40,711 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690124919912.e3aeb5c28430d5dd4b5d6066c4fb4830.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690124920711"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690124920711"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690124920711"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690124920711"}]},"ts":"1690124920711"} 2023-07-23 15:08:40,714 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=106 2023-07-23 15:08:40,714 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure e3aeb5c28430d5dd4b5d6066c4fb4830, server=jenkins-hbase4.apache.org,46239,1690124809597 in 184 msec 2023-07-23 15:08:40,715 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=106, resume processing ppid=105 2023-07-23 15:08:40,716 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e3aeb5c28430d5dd4b5d6066c4fb4830, ASSIGN in 346 msec 2023-07-23 15:08:40,716 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-23 15:08:40,716 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690124920716"}]},"ts":"1690124920716"} 2023-07-23 15:08:40,717 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-23 15:08:40,720 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-23 15:08:40,720 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-23 15:08:40,722 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34279] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-23 15:08:40,723 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:08:40,723 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:08:40,724 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:08:40,723 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:08:40,725 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-23 15:08:40,725 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-23 15:08:40,725 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-23 15:08:40,725 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-23 15:08:40,726 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 813 msec 2023-07-23 15:08:41,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-23 15:08:41,023 INFO [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-23 15:08:41,023 DEBUG [Listener at jenkins-hbase4.apache.org/33035] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithSkipTmp get assigned. Timeout = 60000ms 2023-07-23 15:08:41,023 INFO [Listener at jenkins-hbase4.apache.org/33035] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 15:08:41,026 INFO [Listener at jenkins-hbase4.apache.org/33035] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned to meta. Checking AM states. 2023-07-23 15:08:41,026 INFO [Listener at jenkins-hbase4.apache.org/33035] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 15:08:41,026 INFO [Listener at jenkins-hbase4.apache.org/33035] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned. 2023-07-23 15:08:41,029 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-23 15:08:41,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690124921029 (current time:1690124921029). 2023-07-23 15:08:41,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 15:08:41,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] zookeeper.ReadOnlyZKClient(139): Connect 0x14543b7e to 127.0.0.1:51019 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 15:08:41,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1886a8de, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 15:08:41,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:08:41,038 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57710, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:08:41,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x14543b7e to 127.0.0.1:51019 2023-07-23 15:08:41,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 15:08:41,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] zookeeper.ReadOnlyZKClient(139): Connect 0x6ad47c03 to 127.0.0.1:51019 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 15:08:41,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5f6e25ec, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 15:08:41,046 DEBUG [hconnection-0x7283a687-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:08:41,049 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57712, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:08:41,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6ad47c03 to 127.0.0.1:51019 2023-07-23 15:08:41,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 15:08:41,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-23 15:08:41,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 15:08:41,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-23 15:08:41,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-23 15:08:41,057 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-23 15:08:41,058 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1690125521058 2023-07-23 15:08:41,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-23 15:08:41,058 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,059 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 15:08:41,059 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 15:08:41,060 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-23 15:08:41,060 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-23 15:08:41,061 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-07-23 15:08:41,062 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-23 15:08:41,063 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1690125521063 2023-07-23 15:08:41,080 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,081 INFO [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-23 15:08:41,081 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:08:41,082 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-23 15:08:41,082 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-23 15:08:41,083 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,083 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,084 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:41,084 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:41,084 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:41,084 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:41,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:41,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:41,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:41,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:41,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:41,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:41,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,084 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:41,085 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:41,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,087 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,087 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:41,087 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 15:08:41,087 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,087 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-23 15:08:41,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-23 15:08:41,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-23 15:08:41,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,087 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-23 15:08:41,087 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-23 15:08:41,087 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-23 15:08:41,088 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,088 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,088 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-23 15:08:41,088 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:08:41,088 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-23 15:08:41,088 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:08:41,092 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,092 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-23 15:08:41,092 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-23 15:08:41,092 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-23 15:08:41,092 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-23 15:08:41,092 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-23 15:08:41,092 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:08:41,092 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34279,1690124809505' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-23 15:08:41,092 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46191,1690124809654' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-23 15:08:41,093 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-23 15:08:41,093 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-23 15:08:41,094 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46239,1690124809597' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-23 15:08:41,099 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:41,099 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:41,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:08:41,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:08:41,100 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:41,099 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,100 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,100 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,100 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:08:41,100 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,100 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:08:41,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:08:41,100 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,100 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:08:41,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:08:41,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:41,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:41,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:41,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:08:41,102 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46191,1690124809654' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-23 15:08:41,102 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4af45a35[Count = 1] remaining members to acquire global barrier 2023-07-23 15:08:41,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:41,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:08:41,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:08:41,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:08:41,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:08:41,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:41,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:41,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:41,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:08:41,105 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46239,1690124809597' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-23 15:08:41,105 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4af45a35[Count = 0] remaining members to acquire global barrier 2023-07-23 15:08:41,105 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-23 15:08:41,105 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,107 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,107 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,107 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,107 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-23 15:08:41,107 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-23 15:08:41,107 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-23 15:08:41,107 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-23 15:08:41,107 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,34279,1690124809505' in zk 2023-07-23 15:08:41,107 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 15:08:41,107 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 15:08:41,107 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690124919912.482ac59b1076b7a548733971ddd85e5e. 2023-07-23 15:08:41,107 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690124919912.482ac59b1076b7a548733971ddd85e5e. started... 2023-07-23 15:08:41,109 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 482ac59b1076b7a548733971ddd85e5e: 2023-07-23 15:08:41,109 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-23 15:08:41,110 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:08:41,110 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-23 15:08:41,110 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1690124919912.482ac59b1076b7a548733971ddd85e5e.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,112 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 15:08:41,113 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 15:08:41,113 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:41,111 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690124919912.e3aeb5c28430d5dd4b5d6066c4fb4830. 2023-07-23 15:08:41,111 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 15:08:41,116 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 15:08:41,116 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690124919912.e3aeb5c28430d5dd4b5d6066c4fb4830. started... 2023-07-23 15:08:41,118 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:41,118 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 15:08:41,118 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e3aeb5c28430d5dd4b5d6066c4fb4830: 2023-07-23 15:08:41,119 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1690124919912.e3aeb5c28430d5dd4b5d6066c4fb4830.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,119 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 15:08:41,119 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 15:08:41,160 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 15:08:41,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-23 15:08:41,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-23 15:08:41,161 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 15:08:41,163 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690124919912.482ac59b1076b7a548733971ddd85e5e. completed. 2023-07-23 15:08:41,163 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690124919912.482ac59b1076b7a548733971ddd85e5e. 2023-07-23 15:08:41,163 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 15:08:41,163 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 15:08:41,163 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:41,163 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-23 15:08:41,164 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,46191,1690124809654' in zk 2023-07-23 15:08:41,166 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690124919912.e3aeb5c28430d5dd4b5d6066c4fb4830. completed. 2023-07-23 15:08:41,167 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690124919912.e3aeb5c28430d5dd4b5d6066c4fb4830. 2023-07-23 15:08:41,167 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 15:08:41,167 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 15:08:41,167 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:41,167 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-23 15:08:41,167 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,46239,1690124809597' in zk 2023-07-23 15:08:41,168 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-23 15:08:41,168 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:08:41,168 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-23 15:08:41,168 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:41,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:41,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:08:41,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:08:41,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:08:41,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:08:41,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:41,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:41,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:41,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:08:41,176 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-23 15:08:41,176 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:08:41,176 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-23 15:08:41,178 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:41,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:41,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:41,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:41,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,46191,1690124809654': 2023-07-23 15:08:41,181 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46191,1690124809654' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-23 15:08:41,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:41,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:08:41,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:08:41,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:08:41,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:08:41,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:41,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:41,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:41,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:08:41,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:41,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:41,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:41,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,46239,1690124809597': 2023-07-23 15:08:41,190 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46239,1690124809597' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-23 15:08:41,190 INFO [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-23 15:08:41,190 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 15:08:41,190 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 15:08:41,190 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,190 INFO [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 15:08:41,194 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,194 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,194 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:08:41,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,194 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:41,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:08:41,195 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:41,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,195 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:41,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:41,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:41,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:08:41,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:41,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:41,196 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:41,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,198 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,198 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:41,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:41,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:41,199 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:41,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:08:41,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:41,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:41,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:41,202 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:41,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:08:41,203 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:41,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,204 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:41,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:41,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:41,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:41,211 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:41,211 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:41,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:41,211 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:41,211 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:41,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:41,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:41,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:41,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:41,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:41,211 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:41,211 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:41,211 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:41,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:41,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:41,211 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,212 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,212 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:41,212 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,212 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:08:41,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:41,212 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:41,214 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:41,214 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,214 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:41,214 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,214 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:41,214 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:41,214 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,214 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,212 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:41,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:41,215 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,254 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,308 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-23 15:08:41,308 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,308 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,308 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1690124921058Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690124921212 (+154 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690124921212Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690124921224 (+12 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690124921248 (+24 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1690124921308 (+60 ms) 2023-07-23 15:08:41,312 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-23 15:08:41,313 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 253 msec 2023-07-23 15:08:41,361 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 15:08:41,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-23 15:08:41,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 15:08:41,384 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46239] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1690124919912.e3aeb5c28430d5dd4b5d6066c4fb4830. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 15:08:41,388 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46191] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1690124919912.482ac59b1076b7a548733971ddd85e5e. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 15:08:41,411 DEBUG [Listener at jenkins-hbase4.apache.org/33035] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,411 DEBUG [Listener at jenkins-hbase4.apache.org/33035] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1690124919912.e3aeb5c28430d5dd4b5d6066c4fb4830. 2023-07-23 15:08:41,411 INFO [Listener at jenkins-hbase4.apache.org/33035] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 15:08:41,442 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-23 15:08:41,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690124921442 (current time:1690124921442). 2023-07-23 15:08:41,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 15:08:41,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] zookeeper.ReadOnlyZKClient(139): Connect 0x3d0bde15 to 127.0.0.1:51019 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 15:08:41,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5253e0ad, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 15:08:41,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:08:41,468 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57728, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:08:41,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3d0bde15 to 127.0.0.1:51019 2023-07-23 15:08:41,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 15:08:41,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] zookeeper.ReadOnlyZKClient(139): Connect 0x7154ada0 to 127.0.0.1:51019 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 15:08:41,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@124c3ee9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 15:08:41,578 DEBUG [hconnection-0x5fd7e285-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:08:41,579 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57730, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:08:41,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7154ada0 to 127.0.0.1:51019 2023-07-23 15:08:41,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 15:08:41,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-23 15:08:41,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 15:08:41,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-23 15:08:41,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-23 15:08:41,591 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-23 15:08:41,592 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1690125521592 2023-07-23 15:08:41,592 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-23 15:08:41,593 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 15:08:41,594 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 15:08:41,596 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-23 15:08:41,597 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-23 15:08:41,598 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 8 msec 2023-07-23 15:08:41,599 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-23 15:08:41,600 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1690125521600 2023-07-23 15:08:41,628 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,628 INFO [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-23 15:08:41,628 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:08:41,630 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-23 15:08:41,630 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-23 15:08:41,630 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,631 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,633 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:41,633 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:41,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:41,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:41,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:41,633 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:41,633 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:41,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:41,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:41,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:41,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,633 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:41,633 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:41,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,634 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:41,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,634 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,634 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 15:08:41,634 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,634 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-23 15:08:41,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,635 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-23 15:08:41,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-23 15:08:41,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,635 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-23 15:08:41,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-23 15:08:41,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,635 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-23 15:08:41,640 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,640 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-23 15:08:41,640 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:08:41,642 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-23 15:08:41,642 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-23 15:08:41,642 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34279,1690124809505' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-23 15:08:41,642 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,643 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-23 15:08:41,643 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:08:41,643 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,644 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-23 15:08:41,644 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-23 15:08:41,644 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:08:41,644 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,644 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-23 15:08:41,645 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46239,1690124809597' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-23 15:08:41,645 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-23 15:08:41,645 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-23 15:08:41,645 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46191,1690124809654' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-23 15:08:41,645 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,645 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:08:41,647 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,650 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:41,650 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:41,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:08:41,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:08:41,650 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:41,650 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,650 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:08:41,650 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,650 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:08:41,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:08:41,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:08:41,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:41,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:41,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:41,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:08:41,653 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46239,1690124809597' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-23 15:08:41,653 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@616f59b3[Count = 1] remaining members to acquire global barrier 2023-07-23 15:08:41,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:41,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:08:41,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:08:41,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:08:41,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:08:41,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:41,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:41,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:41,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:08:41,655 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46191,1690124809654' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-23 15:08:41,655 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@616f59b3[Count = 0] remaining members to acquire global barrier 2023-07-23 15:08:41,655 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-23 15:08:41,655 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,660 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,660 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,660 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,660 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-23 15:08:41,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,660 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:41,660 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-23 15:08:41,660 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-23 15:08:41,660 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 15:08:41,660 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 15:08:41,660 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690124919912.e3aeb5c28430d5dd4b5d6066c4fb4830. 2023-07-23 15:08:41,660 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-23 15:08:41,661 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690124919912.e3aeb5c28430d5dd4b5d6066c4fb4830. started... 2023-07-23 15:08:41,661 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 15:08:41,661 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690124919912.482ac59b1076b7a548733971ddd85e5e. 2023-07-23 15:08:41,661 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690124919912.482ac59b1076b7a548733971ddd85e5e. started... 2023-07-23 15:08:41,661 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,34279,1690124809505' in zk 2023-07-23 15:08:41,661 INFO [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e3aeb5c28430d5dd4b5d6066c4fb4830 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-23 15:08:41,661 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 15:08:41,661 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:41,661 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 15:08:41,661 INFO [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 482ac59b1076b7a548733971ddd85e5e 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-23 15:08:41,663 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-23 15:08:41,663 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:08:41,663 DEBUG [member: 'jenkins-hbase4.apache.org,34279,1690124809505' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-23 15:08:41,687 INFO [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithSkipTmp/e3aeb5c28430d5dd4b5d6066c4fb4830/.tmp/cf/759c78bf49664117895f623d9784e0d7 2023-07-23 15:08:41,691 INFO [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithSkipTmp/482ac59b1076b7a548733971ddd85e5e/.tmp/cf/a49eeaf89f724b97889e814532b9fa60 2023-07-23 15:08:41,694 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 15:08:41,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-23 15:08:41,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-23 15:08:41,695 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 15:08:41,696 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithSkipTmp/e3aeb5c28430d5dd4b5d6066c4fb4830/.tmp/cf/759c78bf49664117895f623d9784e0d7 as hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithSkipTmp/e3aeb5c28430d5dd4b5d6066c4fb4830/cf/759c78bf49664117895f623d9784e0d7 2023-07-23 15:08:41,698 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithSkipTmp/482ac59b1076b7a548733971ddd85e5e/.tmp/cf/a49eeaf89f724b97889e814532b9fa60 as hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithSkipTmp/482ac59b1076b7a548733971ddd85e5e/cf/a49eeaf89f724b97889e814532b9fa60 2023-07-23 15:08:41,702 INFO [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithSkipTmp/e3aeb5c28430d5dd4b5d6066c4fb4830/cf/759c78bf49664117895f623d9784e0d7, entries=3, sequenceid=6, filesize=5.0 K 2023-07-23 15:08:41,703 INFO [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for e3aeb5c28430d5dd4b5d6066c4fb4830 in 42ms, sequenceid=6, compaction requested=false 2023-07-23 15:08:41,703 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-23 15:08:41,703 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e3aeb5c28430d5dd4b5d6066c4fb4830: 2023-07-23 15:08:41,704 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1690124919912.e3aeb5c28430d5dd4b5d6066c4fb4830.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,704 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 15:08:41,704 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithSkipTmp/e3aeb5c28430d5dd4b5d6066c4fb4830/cf/759c78bf49664117895f623d9784e0d7] hfiles 2023-07-23 15:08:41,704 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithSkipTmp/e3aeb5c28430d5dd4b5d6066c4fb4830/cf/759c78bf49664117895f623d9784e0d7 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,713 INFO [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithSkipTmp/482ac59b1076b7a548733971ddd85e5e/cf/a49eeaf89f724b97889e814532b9fa60, entries=47, sequenceid=6, filesize=8.0 K 2023-07-23 15:08:41,714 INFO [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 482ac59b1076b7a548733971ddd85e5e in 53ms, sequenceid=6, compaction requested=false 2023-07-23 15:08:41,716 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 482ac59b1076b7a548733971ddd85e5e: 2023-07-23 15:08:41,716 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1690124919912.482ac59b1076b7a548733971ddd85e5e.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,716 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 15:08:41,716 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithSkipTmp/482ac59b1076b7a548733971ddd85e5e/cf/a49eeaf89f724b97889e814532b9fa60] hfiles 2023-07-23 15:08:41,716 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithSkipTmp/482ac59b1076b7a548733971ddd85e5e/cf/a49eeaf89f724b97889e814532b9fa60 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,759 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690124919912.e3aeb5c28430d5dd4b5d6066c4fb4830. completed. 2023-07-23 15:08:41,759 DEBUG [rs(jenkins-hbase4.apache.org,46239,1690124809597)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690124919912.e3aeb5c28430d5dd4b5d6066c4fb4830. 2023-07-23 15:08:41,759 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 15:08:41,759 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 15:08:41,759 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:41,762 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-23 15:08:41,762 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,46239,1690124809597' in zk 2023-07-23 15:08:41,764 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:41,764 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-23 15:08:41,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:41,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:08:41,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:08:41,765 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:08:41,765 DEBUG [member: 'jenkins-hbase4.apache.org,46239,1690124809597' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-23 15:08:41,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:08:41,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:08:41,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:41,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:41,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:41,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:08:41,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,781 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690124919912.482ac59b1076b7a548733971ddd85e5e. completed. 2023-07-23 15:08:41,781 DEBUG [rs(jenkins-hbase4.apache.org,46191,1690124809654)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690124919912.482ac59b1076b7a548733971ddd85e5e. 2023-07-23 15:08:41,781 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 15:08:41,782 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 15:08:41,782 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:41,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:41,782 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-23 15:08:41,782 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,46191,1690124809654' in zk 2023-07-23 15:08:41,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:41,783 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:41,783 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-23 15:08:41,783 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:08:41,783 DEBUG [member: 'jenkins-hbase4.apache.org,46191,1690124809654' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-23 15:08:41,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,46239,1690124809597': 2023-07-23 15:08:41,785 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46239,1690124809597' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-23 15:08:41,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:41,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:08:41,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:08:41,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:08:41,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:08:41,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:41,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:41,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:41,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:08:41,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:41,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:41,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:41,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,46191,1690124809654': 2023-07-23 15:08:41,793 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46191,1690124809654' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-23 15:08:41,793 INFO [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-23 15:08:41,793 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 15:08:41,793 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 15:08:41,793 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,793 INFO [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 15:08:41,798 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,798 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:08:41,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:08:41,798 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,798 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,798 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:41,798 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:41,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:08:41,798 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:41,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:41,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:41,799 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:41,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:41,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:41,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:41,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:41,799 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:41,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:08:41,800 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:41,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:41,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:41,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:41,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:08:41,803 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:41,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,803 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:41,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:41,804 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:41,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:41,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:41,807 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:41,807 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:41,807 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:41,808 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:41,808 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:41,808 DEBUG [(jenkins-hbase4.apache.org,38379,1690124807983)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:08:41,807 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:41,807 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,807 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:41,808 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:41,808 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,808 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:41,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:41,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:41,810 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:41,810 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:41,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:41,810 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,810 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:41,811 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,811 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:41,811 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,811 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:08:41,811 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:41,811 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,811 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:41,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:41,811 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:41,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:41,811 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,811 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:41,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:41,811 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,841 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,878 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-23 15:08:41,878 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,878 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,878 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1690124921592Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1690124921810 (+218 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1690124921811 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1690124921821 (+10 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1690124921833 (+12 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1690124921878 (+45 ms) 2023-07-23 15:08:41,882 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-23 15:08:41,883 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 289 msec 2023-07-23 15:08:41,895 DEBUG [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 15:08:41,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-23 15:08:41,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 15:08:41,897 INFO [Listener at jenkins-hbase4.apache.org/33035] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/export-test/export-1690124921896 2023-07-23 15:08:41,897 INFO [Listener at jenkins-hbase4.apache.org/33035] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:45535, tgtDir=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/export-test/export-1690124921896, rawTgtDir=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/export-test/export-1690124921896, srcFsUri=hdfs://localhost:45535, srcDir=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40 2023-07-23 15:08:41,925 DEBUG [Listener at jenkins-hbase4.apache.org/33035] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45535, inputRoot=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40 2023-07-23 15:08:41,925 DEBUG [Listener at jenkins-hbase4.apache.org/33035] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_645588867_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/export-test/export-1690124921896, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/export-test/export-1690124921896/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,925 INFO [Listener at jenkins-hbase4.apache.org/33035] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45535, inputRoot=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40, snapshotDir=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-23 15:08:41,939 INFO [Listener at jenkins-hbase4.apache.org/33035] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/export-test/export-1690124921896/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,982 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:41,983 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:41,983 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:41,983 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:41,984 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:41,984 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:41,984 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:42,061 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/hadoop-2200990876844250927.jar 2023-07-23 15:08:42,062 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:42,062 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:42,062 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:42,063 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:42,063 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:42,063 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:42,063 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-23 15:08:42,064 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-23 15:08:42,064 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-23 15:08:42,065 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-23 15:08:42,065 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-23 15:08:42,065 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-23 15:08:42,066 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-23 15:08:42,066 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-23 15:08:42,067 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-23 15:08:42,067 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-23 15:08:42,068 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 15:08:42,068 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 15:08:42,068 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 15:08:42,068 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 15:08:42,069 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 15:08:42,069 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 15:08:42,069 DEBUG [Listener at jenkins-hbase4.apache.org/33035] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 15:08:42,803 WARN [Listener at jenkins-hbase4.apache.org/33035] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-23 15:08:42,805 INFO [Listener at jenkins-hbase4.apache.org/33035] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-23 15:08:42,807 DEBUG [Listener at jenkins-hbase4.apache.org/33035] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-23 15:08:44,386 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 15:08:44,386 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 15:08:44,389 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690124817489_0006_000001 (auth:SIMPLE) 2023-07-23 15:08:44,836 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690124817489_0007_000001 (auth:SIMPLE) 2023-07-23 15:08:45,236 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-23 15:08:50,882 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690124817489_0007_000001 (auth:SIMPLE) 2023-07-23 15:08:53,338 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690124817489_0007_000001 (auth:SIMPLE) 2023-07-23 15:08:57,048 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690124817489_0007_000001 (auth:SIMPLE) 2023-07-23 15:08:58,285 INFO [Listener at jenkins-hbase4.apache.org/33035] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-23 15:08:58,285 INFO [Listener at jenkins-hbase4.apache.org/33035] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-23 15:08:58,315 INFO [Listener at jenkins-hbase4.apache.org/33035] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:58,315 INFO [Listener at jenkins-hbase4.apache.org/33035] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-23 15:08:58,316 INFO [Listener at jenkins-hbase4.apache.org/33035] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-23 15:08:58,316 DEBUG [Listener at jenkins-hbase4.apache.org/33035] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-979742745_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:58,317 DEBUG [Listener at jenkins-hbase4.apache.org/33035] snapshot.TestExportSnapshot(367): hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-23 15:08:58,317 DEBUG [Listener at jenkins-hbase4.apache.org/33035] snapshot.TestExportSnapshot(367): hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-23 15:08:58,317 DEBUG [Listener at jenkins-hbase4.apache.org/33035] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-979742745_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/export-test/export-1690124921896/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/export-test/export-1690124921896/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:58,317 DEBUG [Listener at jenkins-hbase4.apache.org/33035] snapshot.TestExportSnapshot(367): hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/export-test/export-1690124921896/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-23 15:08:58,318 DEBUG [Listener at jenkins-hbase4.apache.org/33035] snapshot.TestExportSnapshot(367): hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/export-test/export-1690124921896/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-23 15:08:58,331 INFO [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:58,332 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:58,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:58,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-23 15:08:58,337 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690124938337"}]},"ts":"1690124938337"} 2023-07-23 15:08:58,339 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-23 15:08:58,340 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-23 15:08:58,341 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e3aeb5c28430d5dd4b5d6066c4fb4830, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=482ac59b1076b7a548733971ddd85e5e, UNASSIGN}] 2023-07-23 15:08:58,342 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=482ac59b1076b7a548733971ddd85e5e, UNASSIGN 2023-07-23 15:08:58,343 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e3aeb5c28430d5dd4b5d6066c4fb4830, UNASSIGN 2023-07-23 15:08:58,344 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=482ac59b1076b7a548733971ddd85e5e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:08:58,344 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=e3aeb5c28430d5dd4b5d6066c4fb4830, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:08:58,344 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690124919912.482ac59b1076b7a548733971ddd85e5e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690124938344"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690124938344"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690124938344"}]},"ts":"1690124938344"} 2023-07-23 15:08:58,344 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690124919912.e3aeb5c28430d5dd4b5d6066c4fb4830.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690124938344"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690124938344"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690124938344"}]},"ts":"1690124938344"} 2023-07-23 15:08:58,347 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE; CloseRegionProcedure 482ac59b1076b7a548733971ddd85e5e, server=jenkins-hbase4.apache.org,46191,1690124809654}] 2023-07-23 15:08:58,347 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=115, state=RUNNABLE; CloseRegionProcedure e3aeb5c28430d5dd4b5d6066c4fb4830, server=jenkins-hbase4.apache.org,46239,1690124809597}] 2023-07-23 15:08:58,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-23 15:08:58,499 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 482ac59b1076b7a548733971ddd85e5e 2023-07-23 15:08:58,499 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 482ac59b1076b7a548733971ddd85e5e, disabling compactions & flushes 2023-07-23 15:08:58,499 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1690124919912.482ac59b1076b7a548733971ddd85e5e. 2023-07-23 15:08:58,499 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690124919912.482ac59b1076b7a548733971ddd85e5e. 2023-07-23 15:08:58,499 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690124919912.482ac59b1076b7a548733971ddd85e5e. after waiting 0 ms 2023-07-23 15:08:58,499 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1690124919912.482ac59b1076b7a548733971ddd85e5e. 2023-07-23 15:08:58,500 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e3aeb5c28430d5dd4b5d6066c4fb4830 2023-07-23 15:08:58,500 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e3aeb5c28430d5dd4b5d6066c4fb4830, disabling compactions & flushes 2023-07-23 15:08:58,500 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1690124919912.e3aeb5c28430d5dd4b5d6066c4fb4830. 2023-07-23 15:08:58,500 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690124919912.e3aeb5c28430d5dd4b5d6066c4fb4830. 2023-07-23 15:08:58,500 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690124919912.e3aeb5c28430d5dd4b5d6066c4fb4830. after waiting 0 ms 2023-07-23 15:08:58,500 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1690124919912.e3aeb5c28430d5dd4b5d6066c4fb4830. 2023-07-23 15:08:58,550 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithSkipTmp/e3aeb5c28430d5dd4b5d6066c4fb4830/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 15:08:58,551 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/default/testtb-testExportFileSystemStateWithSkipTmp/482ac59b1076b7a548733971ddd85e5e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 15:08:58,551 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 15:08:58,551 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 15:08:58,553 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1690124919912.482ac59b1076b7a548733971ddd85e5e. 2023-07-23 15:08:58,555 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1690124919912.e3aeb5c28430d5dd4b5d6066c4fb4830. 2023-07-23 15:08:58,555 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 482ac59b1076b7a548733971ddd85e5e: 2023-07-23 15:08:58,555 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e3aeb5c28430d5dd4b5d6066c4fb4830: 2023-07-23 15:08:58,557 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 482ac59b1076b7a548733971ddd85e5e 2023-07-23 15:08:58,557 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=482ac59b1076b7a548733971ddd85e5e, regionState=CLOSED 2023-07-23 15:08:58,557 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690124919912.482ac59b1076b7a548733971ddd85e5e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690124938557"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690124938557"}]},"ts":"1690124938557"} 2023-07-23 15:08:58,558 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e3aeb5c28430d5dd4b5d6066c4fb4830 2023-07-23 15:08:58,558 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=e3aeb5c28430d5dd4b5d6066c4fb4830, regionState=CLOSED 2023-07-23 15:08:58,558 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690124919912.e3aeb5c28430d5dd4b5d6066c4fb4830.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690124938558"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690124938558"}]},"ts":"1690124938558"} 2023-07-23 15:08:58,561 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=116 2023-07-23 15:08:58,561 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; CloseRegionProcedure 482ac59b1076b7a548733971ddd85e5e, server=jenkins-hbase4.apache.org,46191,1690124809654 in 212 msec 2023-07-23 15:08:58,562 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=115 2023-07-23 15:08:58,562 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=115, state=SUCCESS; CloseRegionProcedure e3aeb5c28430d5dd4b5d6066c4fb4830, server=jenkins-hbase4.apache.org,46239,1690124809597 in 213 msec 2023-07-23 15:08:58,563 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=482ac59b1076b7a548733971ddd85e5e, UNASSIGN in 220 msec 2023-07-23 15:08:58,564 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=115, resume processing ppid=114 2023-07-23 15:08:58,564 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e3aeb5c28430d5dd4b5d6066c4fb4830, UNASSIGN in 221 msec 2023-07-23 15:08:58,565 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690124938565"}]},"ts":"1690124938565"} 2023-07-23 15:08:58,566 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-23 15:08:58,568 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-23 15:08:58,570 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 236 msec 2023-07-23 15:08:58,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-23 15:08:58,641 INFO [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-23 15:08:58,642 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:58,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:58,646 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:58,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:58,648 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34279] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:58,650 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:58,652 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:58,652 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:58,652 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:58,653 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:58,655 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-23 15:08:58,655 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-23 15:08:58,655 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-23 15:08:58,655 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-23 15:08:58,657 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:58,657 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:08:58,657 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:58,657 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:08:58,657 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:58,657 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:08:58,657 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:58,657 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:08:58,658 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e3aeb5c28430d5dd4b5d6066c4fb4830 2023-07-23 15:08:58,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-23 15:08:58,659 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/482ac59b1076b7a548733971ddd85e5e 2023-07-23 15:08:58,660 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e3aeb5c28430d5dd4b5d6066c4fb4830/cf, FileablePath, hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e3aeb5c28430d5dd4b5d6066c4fb4830/recovered.edits] 2023-07-23 15:08:58,661 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/482ac59b1076b7a548733971ddd85e5e/cf, FileablePath, hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/482ac59b1076b7a548733971ddd85e5e/recovered.edits] 2023-07-23 15:08:58,666 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e3aeb5c28430d5dd4b5d6066c4fb4830/cf/759c78bf49664117895f623d9784e0d7 to hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e3aeb5c28430d5dd4b5d6066c4fb4830/cf/759c78bf49664117895f623d9784e0d7 2023-07-23 15:08:58,666 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/482ac59b1076b7a548733971ddd85e5e/cf/a49eeaf89f724b97889e814532b9fa60 to hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/482ac59b1076b7a548733971ddd85e5e/cf/a49eeaf89f724b97889e814532b9fa60 2023-07-23 15:08:58,669 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e3aeb5c28430d5dd4b5d6066c4fb4830/recovered.edits/9.seqid to hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e3aeb5c28430d5dd4b5d6066c4fb4830/recovered.edits/9.seqid 2023-07-23 15:08:58,669 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/482ac59b1076b7a548733971ddd85e5e/recovered.edits/9.seqid to hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/482ac59b1076b7a548733971ddd85e5e/recovered.edits/9.seqid 2023-07-23 15:08:58,669 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e3aeb5c28430d5dd4b5d6066c4fb4830 2023-07-23 15:08:58,670 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/482ac59b1076b7a548733971ddd85e5e 2023-07-23 15:08:58,670 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-23 15:08:58,672 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:58,674 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-23 15:08:58,677 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-23 15:08:58,678 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:58,678 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-23 15:08:58,678 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690124919912.e3aeb5c28430d5dd4b5d6066c4fb4830.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690124938678"}]},"ts":"9223372036854775807"} 2023-07-23 15:08:58,679 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690124919912.482ac59b1076b7a548733971ddd85e5e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690124938678"}]},"ts":"9223372036854775807"} 2023-07-23 15:08:58,680 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-23 15:08:58,680 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => e3aeb5c28430d5dd4b5d6066c4fb4830, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1690124919912.e3aeb5c28430d5dd4b5d6066c4fb4830.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 482ac59b1076b7a548733971ddd85e5e, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1690124919912.482ac59b1076b7a548733971ddd85e5e.', STARTKEY => '1', ENDKEY => ''}] 2023-07-23 15:08:58,680 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-23 15:08:58,680 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690124938680"}]},"ts":"9223372036854775807"} 2023-07-23 15:08:58,682 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-23 15:08:58,683 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:58,684 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 41 msec 2023-07-23 15:08:58,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-23 15:08:58,759 INFO [Listener at jenkins-hbase4.apache.org/33035] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-23 15:08:58,766 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-23 15:08:58,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:58,769 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-23 15:08:58,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38379] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:58,798 INFO [Listener at jenkins-hbase4.apache.org/33035] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=770 (was 764) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-979742745_17 at /127.0.0.1:60316 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3d9205bb-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3d9205bb-shared-pool-41 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-979742745_17 at /127.0.0.1:60606 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3d9205bb-shared-pool-40 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3d9205bb-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5209 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1333425484_1 at /127.0.0.1:41880 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (449583813) connection to jenkins-hbase4.apache.org/172.31.14.131:34095 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-979742745_17 at /127.0.0.1:41912 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1333425484_1 at /127.0.0.1:60282 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=913 (was 919), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=531 (was 446) - SystemLoadAverage LEAK? -, ProcessCount=185 (was 180) - ProcessCount LEAK? -, AvailableMemoryMB=4654 (was 5717) 2023-07-23 15:08:58,798 WARN [Listener at jenkins-hbase4.apache.org/33035] hbase.ResourceChecker(130): Thread=770 is superior to 500 2023-07-23 15:08:58,798 INFO [Listener at jenkins-hbase4.apache.org/33035] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-23 15:08:58,809 INFO [Listener at jenkins-hbase4.apache.org/33035] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-23 15:08:58,921 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1690124817489_0007_01_000001 is : 143 2023-07-23 15:09:04,127 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-23 15:09:12,937 INFO [Listener at jenkins-hbase4.apache.org/33035] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-23 15:09:27,056 ERROR [Thread[Thread-409,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-23 15:09:27,057 INFO [Listener at jenkins-hbase4.apache.org/33035] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-23 15:09:27,172 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-23 15:09:27,190 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-23 15:09:27,192 ERROR [Thread[Thread-419,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-23 15:09:27,206 INFO [Listener at jenkins-hbase4.apache.org/33035] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-23 15:09:27,311 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-23 15:09:27,311 INFO [Listener at jenkins-hbase4.apache.org/33035] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-23 15:09:27,311 INFO [Listener at jenkins-hbase4.apache.org/33035] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-23 15:09:27,311 INFO [Listener at jenkins-hbase4.apache.org/33035] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-23 15:09:27,312 DEBUG [Listener at jenkins-hbase4.apache.org/33035] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2f8c14a3 to 127.0.0.1:51019 2023-07-23 15:09:27,312 DEBUG [Listener at jenkins-hbase4.apache.org/33035] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 15:09:27,312 DEBUG [Listener at jenkins-hbase4.apache.org/33035] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-23 15:09:27,312 DEBUG [Listener at jenkins-hbase4.apache.org/33035] util.JVMClusterUtil(257): Found active master hash=1558036752, stopped=false 2023-07-23 15:09:27,312 DEBUG [Listener at jenkins-hbase4.apache.org/33035] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 15:09:27,312 DEBUG [Listener at jenkins-hbase4.apache.org/33035] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-23 15:09:27,312 INFO [Listener at jenkins-hbase4.apache.org/33035] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,38379,1690124807983 2023-07-23 15:09:27,316 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-23 15:09:27,316 INFO [Listener at jenkins-hbase4.apache.org/33035] procedure2.ProcedureExecutor(629): Stopping 2023-07-23 15:09:27,316 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 15:09:27,316 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-23 15:09:27,316 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-23 15:09:27,316 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-23 15:09:27,317 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-23 15:09:27,317 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-23 15:09:27,316 DEBUG [Listener at jenkins-hbase4.apache.org/33035] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x11e331ef to 127.0.0.1:51019 2023-07-23 15:09:27,317 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-23 15:09:27,317 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-23 15:09:27,317 DEBUG [Listener at jenkins-hbase4.apache.org/33035] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 15:09:27,318 INFO [Listener at jenkins-hbase4.apache.org/33035] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,34279,1690124809505' ***** 2023-07-23 15:09:27,318 DEBUG [Listener at jenkins-hbase4.apache.org/33035] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 15:09:27,318 INFO [Listener at jenkins-hbase4.apache.org/33035] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-23 15:09:27,318 INFO [Listener at jenkins-hbase4.apache.org/33035] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,46239,1690124809597' ***** 2023-07-23 15:09:27,318 DEBUG [Listener at jenkins-hbase4.apache.org/33035] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 15:09:27,318 INFO [Listener at jenkins-hbase4.apache.org/33035] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-23 15:09:27,319 INFO [Listener at jenkins-hbase4.apache.org/33035] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,46191,1690124809654' ***** 2023-07-23 15:09:27,319 DEBUG [Listener at jenkins-hbase4.apache.org/33035] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 15:09:27,319 INFO [Listener at jenkins-hbase4.apache.org/33035] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-23 15:09:27,319 INFO [RS:1;jenkins-hbase4:46239] regionserver.HeapMemoryManager(220): Stopping 2023-07-23 15:09:27,319 INFO [RS:0;jenkins-hbase4:34279] regionserver.HeapMemoryManager(220): Stopping 2023-07-23 15:09:27,319 INFO [RS:1;jenkins-hbase4:46239] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-23 15:09:27,319 INFO [RS:2;jenkins-hbase4:46191] regionserver.HeapMemoryManager(220): Stopping 2023-07-23 15:09:27,319 INFO [RS:2;jenkins-hbase4:46191] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-23 15:09:27,319 INFO [RS:2;jenkins-hbase4:46191] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-23 15:09:27,319 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-23 15:09:27,319 INFO [RS:2;jenkins-hbase4:46191] regionserver.HRegionServer(3305): Received CLOSE for 3ed886b7153b08dda7c0db040555d90b 2023-07-23 15:09:27,320 INFO [RS:2;jenkins-hbase4:46191] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:09:27,320 DEBUG [RS:2;jenkins-hbase4:46191] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3a44caff to 127.0.0.1:51019 2023-07-23 15:09:27,320 DEBUG [RS:2;jenkins-hbase4:46191] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 15:09:27,319 INFO [RS:1;jenkins-hbase4:46239] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-23 15:09:27,323 INFO [RS:1;jenkins-hbase4:46239] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:09:27,323 DEBUG [RS:1;jenkins-hbase4:46239] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6d79c67c to 127.0.0.1:51019 2023-07-23 15:09:27,323 DEBUG [RS:1;jenkins-hbase4:46239] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 15:09:27,322 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-23 15:09:27,322 INFO [RS:0;jenkins-hbase4:34279] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-23 15:09:27,324 INFO [RS:0;jenkins-hbase4:34279] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-23 15:09:27,324 INFO [RS:0;jenkins-hbase4:34279] regionserver.HRegionServer(3305): Received CLOSE for 0de123eef788e5c0b4e3e20b5a4d6732 2023-07-23 15:09:27,324 INFO [RS:0;jenkins-hbase4:34279] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:09:27,321 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3ed886b7153b08dda7c0db040555d90b, disabling compactions & flushes 2023-07-23 15:09:27,319 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-23 15:09:27,324 DEBUG [RS:0;jenkins-hbase4:34279] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x41a323be to 127.0.0.1:51019 2023-07-23 15:09:27,324 DEBUG [RS:0;jenkins-hbase4:34279] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 15:09:27,324 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1690124812500.3ed886b7153b08dda7c0db040555d90b. 2023-07-23 15:09:27,324 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1690124812500.3ed886b7153b08dda7c0db040555d90b. 2023-07-23 15:09:27,325 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1690124812500.3ed886b7153b08dda7c0db040555d90b. after waiting 1 ms 2023-07-23 15:09:27,325 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1690124812500.3ed886b7153b08dda7c0db040555d90b. 2023-07-23 15:09:27,325 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 3ed886b7153b08dda7c0db040555d90b 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-23 15:09:27,325 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-23 15:09:27,328 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0de123eef788e5c0b4e3e20b5a4d6732, disabling compactions & flushes 2023-07-23 15:09:27,328 INFO [RS:2;jenkins-hbase4:46191] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-23 15:09:27,328 INFO [RS:1;jenkins-hbase4:46239] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,46239,1690124809597; all regions closed. 2023-07-23 15:09:27,328 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1690124813261.0de123eef788e5c0b4e3e20b5a4d6732. 2023-07-23 15:09:27,329 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1690124813261.0de123eef788e5c0b4e3e20b5a4d6732. 2023-07-23 15:09:27,329 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1690124813261.0de123eef788e5c0b4e3e20b5a4d6732. after waiting 0 ms 2023-07-23 15:09:27,329 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1690124813261.0de123eef788e5c0b4e3e20b5a4d6732. 2023-07-23 15:09:27,328 DEBUG [RS:2;jenkins-hbase4:46191] regionserver.HRegionServer(1478): Online Regions={3ed886b7153b08dda7c0db040555d90b=hbase:namespace,,1690124812500.3ed886b7153b08dda7c0db040555d90b.} 2023-07-23 15:09:27,328 INFO [RS:0;jenkins-hbase4:34279] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-23 15:09:27,330 INFO [RS:0;jenkins-hbase4:34279] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-23 15:09:27,330 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 0de123eef788e5c0b4e3e20b5a4d6732 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-23 15:09:27,330 INFO [RS:0;jenkins-hbase4:34279] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-23 15:09:27,331 INFO [RS:0;jenkins-hbase4:34279] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-23 15:09:27,331 DEBUG [RS:2;jenkins-hbase4:46191] regionserver.HRegionServer(1504): Waiting on 3ed886b7153b08dda7c0db040555d90b 2023-07-23 15:09:27,335 INFO [RS:0;jenkins-hbase4:34279] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-23 15:09:27,336 DEBUG [RS:0;jenkins-hbase4:34279] regionserver.HRegionServer(1478): Online Regions={0de123eef788e5c0b4e3e20b5a4d6732=hbase:acl,,1690124813261.0de123eef788e5c0b4e3e20b5a4d6732., 1588230740=hbase:meta,,1.1588230740} 2023-07-23 15:09:27,336 DEBUG [RS:0;jenkins-hbase4:34279] regionserver.HRegionServer(1504): Waiting on 0de123eef788e5c0b4e3e20b5a4d6732, 1588230740 2023-07-23 15:09:27,337 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-23 15:09:27,337 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-23 15:09:27,337 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-23 15:09:27,337 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-23 15:09:27,337 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-23 15:09:27,338 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-23 15:09:27,354 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-23 15:09:27,360 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-23 15:09:27,396 DEBUG [RS:1;jenkins-hbase4:46239] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/oldWALs 2023-07-23 15:09:27,396 INFO [RS:1;jenkins-hbase4:46239] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46239%2C1690124809597:(num 1690124811725) 2023-07-23 15:09:27,396 DEBUG [RS:1;jenkins-hbase4:46239] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 15:09:27,396 INFO [RS:1;jenkins-hbase4:46239] regionserver.LeaseManager(133): Closed leases 2023-07-23 15:09:27,422 INFO [RS:1;jenkins-hbase4:46239] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-23 15:09:27,423 INFO [RS:1;jenkins-hbase4:46239] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-23 15:09:27,423 INFO [RS:1;jenkins-hbase4:46239] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-23 15:09:27,423 INFO [RS:1;jenkins-hbase4:46239] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-23 15:09:27,424 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-23 15:09:27,425 INFO [RS:1;jenkins-hbase4:46239] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46239 2023-07-23 15:09:27,435 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/hbase/namespace/3ed886b7153b08dda7c0db040555d90b/.tmp/info/b812c41d08cb437bb0fb88fdad84dc93 2023-07-23 15:09:27,440 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:09:27,440 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-23 15:09:27,440 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:09:27,440 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-23 15:09:27,440 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46239,1690124809597 2023-07-23 15:09:27,440 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-23 15:09:27,440 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-23 15:09:27,441 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,46239,1690124809597] 2023-07-23 15:09:27,447 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/hbase/acl/0de123eef788e5c0b4e3e20b5a4d6732/.tmp/l/ec2662f4ddce4512b90baa6542aa1fb1 2023-07-23 15:09:27,456 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,46239,1690124809597; numProcessing=1 2023-07-23 15:09:27,461 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ec2662f4ddce4512b90baa6542aa1fb1 2023-07-23 15:09:27,462 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/hbase/acl/0de123eef788e5c0b4e3e20b5a4d6732/.tmp/l/ec2662f4ddce4512b90baa6542aa1fb1 as hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/hbase/acl/0de123eef788e5c0b4e3e20b5a4d6732/l/ec2662f4ddce4512b90baa6542aa1fb1 2023-07-23 15:09:27,469 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ec2662f4ddce4512b90baa6542aa1fb1 2023-07-23 15:09:27,469 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/hbase/acl/0de123eef788e5c0b4e3e20b5a4d6732/l/ec2662f4ddce4512b90baa6542aa1fb1, entries=7, sequenceid=18, filesize=5.2 K 2023-07-23 15:09:27,471 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 0de123eef788e5c0b4e3e20b5a4d6732 in 142ms, sequenceid=18, compaction requested=false 2023-07-23 15:09:27,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/hbase/namespace/3ed886b7153b08dda7c0db040555d90b/.tmp/info/b812c41d08cb437bb0fb88fdad84dc93 as hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/hbase/namespace/3ed886b7153b08dda7c0db040555d90b/info/b812c41d08cb437bb0fb88fdad84dc93 2023-07-23 15:09:27,499 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/hbase/namespace/3ed886b7153b08dda7c0db040555d90b/info/b812c41d08cb437bb0fb88fdad84dc93, entries=2, sequenceid=6, filesize=4.8 K 2023-07-23 15:09:27,500 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 3ed886b7153b08dda7c0db040555d90b in 175ms, sequenceid=6, compaction requested=false 2023-07-23 15:09:27,510 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/hbase/meta/1588230740/.tmp/info/01b3f4bef4764bf3b2706625f717cae6 2023-07-23 15:09:27,523 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,46239,1690124809597 already deleted, retry=false 2023-07-23 15:09:27,523 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,46239,1690124809597 expired; onlineServers=2 2023-07-23 15:09:27,532 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 01b3f4bef4764bf3b2706625f717cae6 2023-07-23 15:09:27,532 DEBUG [RS:2;jenkins-hbase4:46191] regionserver.HRegionServer(1504): Waiting on 3ed886b7153b08dda7c0db040555d90b 2023-07-23 15:09:27,537 DEBUG [RS:0;jenkins-hbase4:34279] regionserver.HRegionServer(1504): Waiting on 0de123eef788e5c0b4e3e20b5a4d6732, 1588230740 2023-07-23 15:09:27,538 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/hbase/acl/0de123eef788e5c0b4e3e20b5a4d6732/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-23 15:09:27,542 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 15:09:27,543 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1690124813261.0de123eef788e5c0b4e3e20b5a4d6732. 2023-07-23 15:09:27,543 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0de123eef788e5c0b4e3e20b5a4d6732: 2023-07-23 15:09:27,544 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1690124813261.0de123eef788e5c0b4e3e20b5a4d6732. 2023-07-23 15:09:27,549 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/hbase/namespace/3ed886b7153b08dda7c0db040555d90b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 15:09:27,562 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-23 15:09:27,562 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46239-0x10192b86e830002, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-23 15:09:27,562 INFO [RS:1;jenkins-hbase4:46239] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,46239,1690124809597; zookeeper connection closed. 2023-07-23 15:09:27,571 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 15:09:27,587 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6bf68d68] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6bf68d68 2023-07-23 15:09:27,592 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1690124812500.3ed886b7153b08dda7c0db040555d90b. 2023-07-23 15:09:27,592 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3ed886b7153b08dda7c0db040555d90b: 2023-07-23 15:09:27,592 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1690124812500.3ed886b7153b08dda7c0db040555d90b. 2023-07-23 15:09:27,624 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/hbase/meta/1588230740/.tmp/rep_barrier/f0e992d5871b435d9c436d2248dc3bc7 2023-07-23 15:09:27,629 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f0e992d5871b435d9c436d2248dc3bc7 2023-07-23 15:09:27,652 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/hbase/meta/1588230740/.tmp/table/767d381dd5fe452ebcff38d83b4f3ed8 2023-07-23 15:09:27,657 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 767d381dd5fe452ebcff38d83b4f3ed8 2023-07-23 15:09:27,658 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/hbase/meta/1588230740/.tmp/info/01b3f4bef4764bf3b2706625f717cae6 as hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/hbase/meta/1588230740/info/01b3f4bef4764bf3b2706625f717cae6 2023-07-23 15:09:27,661 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-23 15:09:27,661 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-23 15:09:27,663 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 01b3f4bef4764bf3b2706625f717cae6 2023-07-23 15:09:27,664 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/hbase/meta/1588230740/info/01b3f4bef4764bf3b2706625f717cae6, entries=48, sequenceid=131, filesize=10.3 K 2023-07-23 15:09:27,664 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/hbase/meta/1588230740/.tmp/rep_barrier/f0e992d5871b435d9c436d2248dc3bc7 as hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/hbase/meta/1588230740/rep_barrier/f0e992d5871b435d9c436d2248dc3bc7 2023-07-23 15:09:27,669 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f0e992d5871b435d9c436d2248dc3bc7 2023-07-23 15:09:27,669 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/hbase/meta/1588230740/rep_barrier/f0e992d5871b435d9c436d2248dc3bc7, entries=13, sequenceid=131, filesize=6.4 K 2023-07-23 15:09:27,670 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/hbase/meta/1588230740/.tmp/table/767d381dd5fe452ebcff38d83b4f3ed8 as hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/hbase/meta/1588230740/table/767d381dd5fe452ebcff38d83b4f3ed8 2023-07-23 15:09:27,675 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 767d381dd5fe452ebcff38d83b4f3ed8 2023-07-23 15:09:27,675 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/hbase/meta/1588230740/table/767d381dd5fe452ebcff38d83b4f3ed8, entries=24, sequenceid=131, filesize=6.9 K 2023-07-23 15:09:27,676 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 338ms, sequenceid=131, compaction requested=false 2023-07-23 15:09:27,688 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-23 15:09:27,689 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 15:09:27,689 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-23 15:09:27,690 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-23 15:09:27,690 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-23 15:09:27,690 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-23 15:09:27,723 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-23 15:09:27,723 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-23 15:09:27,735 INFO [RS:2;jenkins-hbase4:46191] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,46191,1690124809654; all regions closed. 2023-07-23 15:09:27,737 INFO [RS:0;jenkins-hbase4:34279] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,34279,1690124809505; all regions closed. 2023-07-23 15:09:27,760 DEBUG [RS:0;jenkins-hbase4:34279] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/oldWALs 2023-07-23 15:09:27,760 INFO [RS:0;jenkins-hbase4:34279] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34279%2C1690124809505.meta:.meta(num 1690124812135) 2023-07-23 15:09:27,775 DEBUG [RS:2;jenkins-hbase4:46191] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/oldWALs 2023-07-23 15:09:27,776 INFO [RS:2;jenkins-hbase4:46191] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46191%2C1690124809654:(num 1690124811812) 2023-07-23 15:09:27,776 DEBUG [RS:2;jenkins-hbase4:46191] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 15:09:27,776 INFO [RS:2;jenkins-hbase4:46191] regionserver.LeaseManager(133): Closed leases 2023-07-23 15:09:27,776 INFO [RS:2;jenkins-hbase4:46191] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-23 15:09:27,777 INFO [RS:2;jenkins-hbase4:46191] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-23 15:09:27,777 INFO [RS:2;jenkins-hbase4:46191] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-23 15:09:27,777 INFO [RS:2;jenkins-hbase4:46191] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-23 15:09:27,777 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-23 15:09:27,777 INFO [RS:2;jenkins-hbase4:46191] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46191 2023-07-23 15:09:27,779 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:09:27,779 DEBUG [RS:0;jenkins-hbase4:34279] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/oldWALs 2023-07-23 15:09:27,779 INFO [RS:0;jenkins-hbase4:34279] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34279%2C1690124809505:(num 1690124811837) 2023-07-23 15:09:27,779 DEBUG [RS:0;jenkins-hbase4:34279] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 15:09:27,779 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-23 15:09:27,780 INFO [RS:0;jenkins-hbase4:34279] regionserver.LeaseManager(133): Closed leases 2023-07-23 15:09:27,780 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46191,1690124809654 2023-07-23 15:09:27,780 INFO [RS:0;jenkins-hbase4:34279] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-23 15:09:27,780 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-23 15:09:27,781 INFO [RS:0;jenkins-hbase4:34279] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34279 2023-07-23 15:09:27,782 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,46191,1690124809654] 2023-07-23 15:09:27,782 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,46191,1690124809654; numProcessing=2 2023-07-23 15:09:27,783 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34279,1690124809505 2023-07-23 15:09:27,783 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-23 15:09:27,785 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,46191,1690124809654 already deleted, retry=false 2023-07-23 15:09:27,785 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,46191,1690124809654 expired; onlineServers=1 2023-07-23 15:09:27,785 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34279,1690124809505] 2023-07-23 15:09:27,785 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34279,1690124809505; numProcessing=3 2023-07-23 15:09:27,786 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34279,1690124809505 already deleted, retry=false 2023-07-23 15:09:27,787 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34279,1690124809505 expired; onlineServers=0 2023-07-23 15:09:27,787 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,38379,1690124807983' ***** 2023-07-23 15:09:27,787 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-23 15:09:27,787 DEBUG [M:0;jenkins-hbase4:38379] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1de0cb2b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-23 15:09:27,787 INFO [M:0;jenkins-hbase4:38379] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,38379,1690124807983 2023-07-23 15:09:27,787 INFO [M:0;jenkins-hbase4:38379] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,38379,1690124807983; all regions closed. 2023-07-23 15:09:27,787 DEBUG [M:0;jenkins-hbase4:38379] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 15:09:27,787 DEBUG [M:0;jenkins-hbase4:38379] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-23 15:09:27,787 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-23 15:09:27,787 DEBUG [M:0;jenkins-hbase4:38379] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-23 15:09:27,787 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1690124811287] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1690124811287,5,FailOnTimeoutGroup] 2023-07-23 15:09:27,787 INFO [M:0;jenkins-hbase4:38379] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-23 15:09:27,787 INFO [M:0;jenkins-hbase4:38379] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-23 15:09:27,788 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1690124811282] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1690124811282,5,FailOnTimeoutGroup] 2023-07-23 15:09:27,788 INFO [M:0;jenkins-hbase4:38379] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-23 15:09:27,788 DEBUG [M:0;jenkins-hbase4:38379] master.HMaster(1512): Stopping service threads 2023-07-23 15:09:27,788 INFO [M:0;jenkins-hbase4:38379] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-23 15:09:27,788 ERROR [M:0;jenkins-hbase4:38379] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-23 15:09:27,789 INFO [M:0;jenkins-hbase4:38379] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-23 15:09:27,789 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-23 15:09:27,789 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-23 15:09:27,789 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 15:09:27,790 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-23 15:09:27,790 DEBUG [M:0;jenkins-hbase4:38379] zookeeper.ZKUtil(398): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-23 15:09:27,790 WARN [M:0;jenkins-hbase4:38379] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-23 15:09:27,790 INFO [M:0;jenkins-hbase4:38379] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-23 15:09:27,790 INFO [M:0;jenkins-hbase4:38379] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-23 15:09:27,791 DEBUG [M:0;jenkins-hbase4:38379] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-23 15:09:27,791 INFO [M:0;jenkins-hbase4:38379] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-23 15:09:27,791 DEBUG [M:0;jenkins-hbase4:38379] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-23 15:09:27,791 DEBUG [M:0;jenkins-hbase4:38379] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-23 15:09:27,791 DEBUG [M:0;jenkins-hbase4:38379] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-23 15:09:27,791 INFO [M:0;jenkins-hbase4:38379] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=373.10 KB heapSize=449.34 KB 2023-07-23 15:09:27,822 INFO [M:0;jenkins-hbase4:38379] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=373.10 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/4444db912cb6413e86f45b17bc7c0662 2023-07-23 15:09:27,834 INFO [M:0;jenkins-hbase4:38379] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4444db912cb6413e86f45b17bc7c0662 2023-07-23 15:09:27,835 DEBUG [M:0;jenkins-hbase4:38379] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/4444db912cb6413e86f45b17bc7c0662 as hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/4444db912cb6413e86f45b17bc7c0662 2023-07-23 15:09:27,841 INFO [M:0;jenkins-hbase4:38379] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4444db912cb6413e86f45b17bc7c0662 2023-07-23 15:09:27,841 INFO [M:0;jenkins-hbase4:38379] regionserver.HStore(1080): Added hdfs://localhost:45535/user/jenkins/test-data/747943db-c514-2312-77d8-001c6c9b9d40/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/4444db912cb6413e86f45b17bc7c0662, entries=119, sequenceid=899, filesize=28.4 K 2023-07-23 15:09:27,844 INFO [M:0;jenkins-hbase4:38379] regionserver.HRegion(2948): Finished flush of dataSize ~373.10 KB/382052, heapSize ~449.32 KB/460104, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 52ms, sequenceid=899, compaction requested=false 2023-07-23 15:09:27,864 INFO [M:0;jenkins-hbase4:38379] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-23 15:09:27,864 DEBUG [M:0;jenkins-hbase4:38379] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-23 15:09:27,870 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-23 15:09:27,871 INFO [M:0;jenkins-hbase4:38379] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-23 15:09:27,872 INFO [M:0;jenkins-hbase4:38379] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38379 2023-07-23 15:09:27,875 DEBUG [M:0;jenkins-hbase4:38379] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,38379,1690124807983 already deleted, retry=false 2023-07-23 15:09:27,882 INFO [RS:2;jenkins-hbase4:46191] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,46191,1690124809654; zookeeper connection closed. 2023-07-23 15:09:27,882 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-23 15:09:27,882 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x10192b86e830003, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-23 15:09:27,882 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4d617e3e] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4d617e3e 2023-07-23 15:09:27,982 INFO [M:0;jenkins-hbase4:38379] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,38379,1690124807983; zookeeper connection closed. 2023-07-23 15:09:27,982 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-23 15:09:27,982 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): master:38379-0x10192b86e830000, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-23 15:09:28,082 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-23 15:09:28,082 INFO [RS:0;jenkins-hbase4:34279] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,34279,1690124809505; zookeeper connection closed. 2023-07-23 15:09:28,082 DEBUG [Listener at localhost/36099-EventThread] zookeeper.ZKWatcher(600): regionserver:34279-0x10192b86e830001, quorum=127.0.0.1:51019, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-23 15:09:28,082 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4fc617f0] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4fc617f0 2023-07-23 15:09:28,083 INFO [Listener at jenkins-hbase4.apache.org/33035] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-23 15:09:28,083 WARN [Listener at jenkins-hbase4.apache.org/33035] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-23 15:09:28,099 INFO [Listener at jenkins-hbase4.apache.org/33035] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-23 15:09:28,165 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 15:09:28,165 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-23 15:09:28,166 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 15:09:28,166 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-23 15:09:28,166 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 15:09:28,206 WARN [BP-1707680536-172.31.14.131-1690124803804 heartbeating to localhost/127.0.0.1:45535] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-23 15:09:28,206 WARN [BP-1707680536-172.31.14.131-1690124803804 heartbeating to localhost/127.0.0.1:45535] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1707680536-172.31.14.131-1690124803804 (Datanode Uuid 4f6bb693-a32e-4ced-9bf1-f2622ba7195f) service to localhost/127.0.0.1:45535 2023-07-23 15:09:28,208 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/cluster_1af599d2-744d-4b83-6c9a-48c564e4b3e8/dfs/data/data5/current/BP-1707680536-172.31.14.131-1690124803804] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-23 15:09:28,209 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/cluster_1af599d2-744d-4b83-6c9a-48c564e4b3e8/dfs/data/data6/current/BP-1707680536-172.31.14.131-1690124803804] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-23 15:09:28,210 WARN [Listener at jenkins-hbase4.apache.org/33035] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-23 15:09:28,221 INFO [Listener at jenkins-hbase4.apache.org/33035] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-23 15:09:28,226 WARN [BP-1707680536-172.31.14.131-1690124803804 heartbeating to localhost/127.0.0.1:45535] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-23 15:09:28,226 WARN [BP-1707680536-172.31.14.131-1690124803804 heartbeating to localhost/127.0.0.1:45535] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1707680536-172.31.14.131-1690124803804 (Datanode Uuid 2cb3246c-5bcf-49cb-8949-09f6a494735a) service to localhost/127.0.0.1:45535 2023-07-23 15:09:28,227 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/cluster_1af599d2-744d-4b83-6c9a-48c564e4b3e8/dfs/data/data3/current/BP-1707680536-172.31.14.131-1690124803804] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-23 15:09:28,228 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/cluster_1af599d2-744d-4b83-6c9a-48c564e4b3e8/dfs/data/data4/current/BP-1707680536-172.31.14.131-1690124803804] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-23 15:09:28,230 WARN [Listener at jenkins-hbase4.apache.org/33035] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-23 15:09:28,279 INFO [Listener at jenkins-hbase4.apache.org/33035] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-23 15:09:28,281 WARN [BP-1707680536-172.31.14.131-1690124803804 heartbeating to localhost/127.0.0.1:45535] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-23 15:09:28,281 WARN [BP-1707680536-172.31.14.131-1690124803804 heartbeating to localhost/127.0.0.1:45535] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1707680536-172.31.14.131-1690124803804 (Datanode Uuid 75df1146-43fe-4fbb-b2d1-cef7e0742ddf) service to localhost/127.0.0.1:45535 2023-07-23 15:09:28,282 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/cluster_1af599d2-744d-4b83-6c9a-48c564e4b3e8/dfs/data/data1/current/BP-1707680536-172.31.14.131-1690124803804] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-23 15:09:28,284 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c35c2897-dfb4-71c3-4071-c7b9337d46f6/cluster_1af599d2-744d-4b83-6c9a-48c564e4b3e8/dfs/data/data2/current/BP-1707680536-172.31.14.131-1690124803804] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-23 15:09:28,322 INFO [Listener at jenkins-hbase4.apache.org/33035] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-23 15:09:28,448 INFO [Listener at jenkins-hbase4.apache.org/33035] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-23 15:09:28,593 INFO [Listener at jenkins-hbase4.apache.org/33035] hbase.HBaseTestingUtility(1293): Minicluster is down