2023-07-18 10:10:20,459 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-18 10:10:20,733 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd 2023-07-18 10:10:20,734 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestSecureExportSnapshot timeout: 13 mins 2023-07-18 10:10:20,776 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-18 10:10:21,027 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-18 10:10:21,028 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/cluster_c337c4fc-2ada-e3f9-7d55-d4eaef1ef56e, deleteOnExit=true 2023-07-18 10:10:21,028 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-18 10:10:21,029 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/test.cache.data in system properties and HBase conf 2023-07-18 10:10:21,029 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/hadoop.tmp.dir in system properties and HBase conf 2023-07-18 10:10:21,030 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/hadoop.log.dir in system properties and HBase conf 2023-07-18 10:10:21,031 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-18 10:10:21,031 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-18 10:10:21,031 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-18 10:10:21,363 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-18 10:10:21,369 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-18 10:10:21,369 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-18 10:10:21,370 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-18 10:10:21,370 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-18 10:10:21,371 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-18 10:10:21,371 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-18 10:10:21,374 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-18 10:10:21,376 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-18 10:10:21,377 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-18 10:10:21,377 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/nfs.dump.dir in system properties and HBase conf 2023-07-18 10:10:21,377 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/java.io.tmpdir in system properties and HBase conf 2023-07-18 10:10:21,378 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-18 10:10:21,378 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-18 10:10:21,378 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-18 10:10:21,944 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-18 10:10:21,948 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-18 10:10:22,218 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-18 10:10:22,387 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-18 10:10:22,407 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-18 10:10:22,453 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-18 10:10:22,489 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/java.io.tmpdir/Jetty_localhost_35167_hdfs____epluii/webapp 2023-07-18 10:10:22,641 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35167 2023-07-18 10:10:22,676 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-18 10:10:22,676 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-18 10:10:23,236 WARN [Listener at localhost/35953] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-18 10:10:23,371 WARN [Listener at localhost/35953] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-18 10:10:23,394 WARN [Listener at localhost/35953] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-18 10:10:23,404 INFO [Listener at localhost/35953] log.Slf4jLog(67): jetty-6.1.26 2023-07-18 10:10:23,412 INFO [Listener at localhost/35953] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/java.io.tmpdir/Jetty_localhost_38057_datanode____.ahx3rg/webapp 2023-07-18 10:10:23,567 INFO [Listener at localhost/35953] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38057 2023-07-18 10:10:24,087 WARN [Listener at localhost/36021] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-18 10:10:24,114 WARN [Listener at localhost/36021] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-18 10:10:24,126 WARN [Listener at localhost/36021] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-18 10:10:24,129 INFO [Listener at localhost/36021] log.Slf4jLog(67): jetty-6.1.26 2023-07-18 10:10:24,134 INFO [Listener at localhost/36021] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/java.io.tmpdir/Jetty_localhost_46047_datanode____.xwe4dk/webapp 2023-07-18 10:10:24,255 INFO [Listener at localhost/36021] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46047 2023-07-18 10:10:24,278 WARN [Listener at localhost/44037] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-18 10:10:24,320 WARN [Listener at localhost/44037] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-18 10:10:24,326 WARN [Listener at localhost/44037] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-18 10:10:24,327 INFO [Listener at localhost/44037] log.Slf4jLog(67): jetty-6.1.26 2023-07-18 10:10:24,335 INFO [Listener at localhost/44037] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/java.io.tmpdir/Jetty_localhost_44627_datanode____78myn6/webapp 2023-07-18 10:10:24,508 INFO [Listener at localhost/44037] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44627 2023-07-18 10:10:24,533 WARN [Listener at localhost/44535] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-18 10:10:24,771 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9122912f4c60ea07: Processing first storage report for DS-a3337cd2-93ed-4161-a276-2b5588811623 from datanode 53edb0d3-2f85-456e-b7c5-1922100b04ad 2023-07-18 10:10:24,775 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9122912f4c60ea07: from storage DS-a3337cd2-93ed-4161-a276-2b5588811623 node DatanodeRegistration(127.0.0.1:37427, datanodeUuid=53edb0d3-2f85-456e-b7c5-1922100b04ad, infoPort=32811, infoSecurePort=0, ipcPort=36021, storageInfo=lv=-57;cid=testClusterID;nsid=1217571370;c=1689675022015), blocks: 0, hasStaleStorage: true, processing time: 4 msecs, invalidatedBlocks: 0 2023-07-18 10:10:24,775 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xea56dbf412523a95: Processing first storage report for DS-37dffcbf-8daf-4233-8778-5da521e742cb from datanode a7961726-788a-4c7f-9006-c9268c78154c 2023-07-18 10:10:24,775 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xea56dbf412523a95: from storage DS-37dffcbf-8daf-4233-8778-5da521e742cb node DatanodeRegistration(127.0.0.1:43765, datanodeUuid=a7961726-788a-4c7f-9006-c9268c78154c, infoPort=40203, infoSecurePort=0, ipcPort=44037, storageInfo=lv=-57;cid=testClusterID;nsid=1217571370;c=1689675022015), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-18 10:10:24,776 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xea56dbf412523a95: Processing first storage report for DS-e8b76dfd-d562-416c-9f5d-ed1ad65463c6 from datanode a7961726-788a-4c7f-9006-c9268c78154c 2023-07-18 10:10:24,776 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xea56dbf412523a95: from storage DS-e8b76dfd-d562-416c-9f5d-ed1ad65463c6 node DatanodeRegistration(127.0.0.1:43765, datanodeUuid=a7961726-788a-4c7f-9006-c9268c78154c, infoPort=40203, infoSecurePort=0, ipcPort=44037, storageInfo=lv=-57;cid=testClusterID;nsid=1217571370;c=1689675022015), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-18 10:10:24,778 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9122912f4c60ea07: Processing first storage report for DS-f92d5fc1-9436-4bc4-915d-5e4c6297dfaa from datanode 53edb0d3-2f85-456e-b7c5-1922100b04ad 2023-07-18 10:10:24,778 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9122912f4c60ea07: from storage DS-f92d5fc1-9436-4bc4-915d-5e4c6297dfaa node DatanodeRegistration(127.0.0.1:37427, datanodeUuid=53edb0d3-2f85-456e-b7c5-1922100b04ad, infoPort=32811, infoSecurePort=0, ipcPort=36021, storageInfo=lv=-57;cid=testClusterID;nsid=1217571370;c=1689675022015), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-18 10:10:24,806 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4e9405e2f8ad3825: Processing first storage report for DS-e0183efe-ee9f-4d95-af97-43af21a8f84a from datanode 89726bd3-6646-480a-9362-ca327c33d43e 2023-07-18 10:10:24,806 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4e9405e2f8ad3825: from storage DS-e0183efe-ee9f-4d95-af97-43af21a8f84a node DatanodeRegistration(127.0.0.1:46263, datanodeUuid=89726bd3-6646-480a-9362-ca327c33d43e, infoPort=43187, infoSecurePort=0, ipcPort=44535, storageInfo=lv=-57;cid=testClusterID;nsid=1217571370;c=1689675022015), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-18 10:10:24,806 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4e9405e2f8ad3825: Processing first storage report for DS-f6d432b4-a0aa-466d-9d1c-38bd47935130 from datanode 89726bd3-6646-480a-9362-ca327c33d43e 2023-07-18 10:10:24,806 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4e9405e2f8ad3825: from storage DS-f6d432b4-a0aa-466d-9d1c-38bd47935130 node DatanodeRegistration(127.0.0.1:46263, datanodeUuid=89726bd3-6646-480a-9362-ca327c33d43e, infoPort=43187, infoSecurePort=0, ipcPort=44535, storageInfo=lv=-57;cid=testClusterID;nsid=1217571370;c=1689675022015), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-18 10:10:25,025 DEBUG [Listener at localhost/44535] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd 2023-07-18 10:10:25,116 INFO [Listener at localhost/44535] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/cluster_c337c4fc-2ada-e3f9-7d55-d4eaef1ef56e/zookeeper_0, clientPort=56089, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/cluster_c337c4fc-2ada-e3f9-7d55-d4eaef1ef56e/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/cluster_c337c4fc-2ada-e3f9-7d55-d4eaef1ef56e/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-18 10:10:25,136 INFO [Listener at localhost/44535] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=56089 2023-07-18 10:10:25,146 INFO [Listener at localhost/44535] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 10:10:25,149 INFO [Listener at localhost/44535] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 10:10:25,849 INFO [Listener at localhost/44535] util.FSUtils(471): Created version file at hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336 with version=8 2023-07-18 10:10:25,849 INFO [Listener at localhost/44535] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/hbase-staging 2023-07-18 10:10:26,230 INFO [Listener at localhost/44535] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-18 10:10:26,852 INFO [Listener at localhost/44535] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-18 10:10:26,902 INFO [Listener at localhost/44535] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 10:10:26,902 INFO [Listener at localhost/44535] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-18 10:10:26,903 INFO [Listener at localhost/44535] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-18 10:10:26,903 INFO [Listener at localhost/44535] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 10:10:26,903 INFO [Listener at localhost/44535] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-18 10:10:27,064 INFO [Listener at localhost/44535] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-18 10:10:27,156 DEBUG [Listener at localhost/44535] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-18 10:10:27,266 INFO [Listener at localhost/44535] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46557 2023-07-18 10:10:27,280 INFO [Listener at localhost/44535] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 10:10:27,282 INFO [Listener at localhost/44535] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 10:10:27,306 INFO [Listener at localhost/44535] zookeeper.RecoverableZooKeeper(93): Process identifier=master:46557 connecting to ZooKeeper ensemble=127.0.0.1:56089 2023-07-18 10:10:27,357 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:465570x0, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-18 10:10:27,364 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:46557-0x10177e94dcb0000 connected 2023-07-18 10:10:27,403 DEBUG [Listener at localhost/44535] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-18 10:10:27,404 DEBUG [Listener at localhost/44535] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 10:10:27,423 DEBUG [Listener at localhost/44535] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-18 10:10:27,432 DEBUG [Listener at localhost/44535] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46557 2023-07-18 10:10:27,432 DEBUG [Listener at localhost/44535] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46557 2023-07-18 10:10:27,433 DEBUG [Listener at localhost/44535] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46557 2023-07-18 10:10:27,434 DEBUG [Listener at localhost/44535] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46557 2023-07-18 10:10:27,435 DEBUG [Listener at localhost/44535] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46557 2023-07-18 10:10:27,444 INFO [Listener at localhost/44535] master.HMaster(444): hbase.rootdir=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336, hbase.cluster.distributed=false 2023-07-18 10:10:27,524 INFO [Listener at localhost/44535] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-18 10:10:27,525 INFO [Listener at localhost/44535] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 10:10:27,525 INFO [Listener at localhost/44535] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-18 10:10:27,525 INFO [Listener at localhost/44535] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-18 10:10:27,525 INFO [Listener at localhost/44535] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 10:10:27,525 INFO [Listener at localhost/44535] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-18 10:10:27,531 INFO [Listener at localhost/44535] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-18 10:10:27,537 INFO [Listener at localhost/44535] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40089 2023-07-18 10:10:27,540 INFO [Listener at localhost/44535] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-18 10:10:27,551 DEBUG [Listener at localhost/44535] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-18 10:10:27,553 INFO [Listener at localhost/44535] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 10:10:27,556 INFO [Listener at localhost/44535] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 10:10:27,558 INFO [Listener at localhost/44535] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40089 connecting to ZooKeeper ensemble=127.0.0.1:56089 2023-07-18 10:10:27,565 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:400890x0, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-18 10:10:27,566 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:40089-0x10177e94dcb0001 connected 2023-07-18 10:10:27,566 DEBUG [Listener at localhost/44535] zookeeper.ZKUtil(164): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-18 10:10:27,568 DEBUG [Listener at localhost/44535] zookeeper.ZKUtil(164): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 10:10:27,569 DEBUG [Listener at localhost/44535] zookeeper.ZKUtil(164): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-18 10:10:27,570 DEBUG [Listener at localhost/44535] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40089 2023-07-18 10:10:27,571 DEBUG [Listener at localhost/44535] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40089 2023-07-18 10:10:27,571 DEBUG [Listener at localhost/44535] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40089 2023-07-18 10:10:27,574 DEBUG [Listener at localhost/44535] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40089 2023-07-18 10:10:27,576 DEBUG [Listener at localhost/44535] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40089 2023-07-18 10:10:27,590 INFO [Listener at localhost/44535] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-18 10:10:27,590 INFO [Listener at localhost/44535] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 10:10:27,590 INFO [Listener at localhost/44535] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-18 10:10:27,591 INFO [Listener at localhost/44535] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-18 10:10:27,591 INFO [Listener at localhost/44535] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 10:10:27,591 INFO [Listener at localhost/44535] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-18 10:10:27,592 INFO [Listener at localhost/44535] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-18 10:10:27,596 INFO [Listener at localhost/44535] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34221 2023-07-18 10:10:27,597 INFO [Listener at localhost/44535] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-18 10:10:27,598 DEBUG [Listener at localhost/44535] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-18 10:10:27,599 INFO [Listener at localhost/44535] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 10:10:27,604 INFO [Listener at localhost/44535] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 10:10:27,612 INFO [Listener at localhost/44535] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34221 connecting to ZooKeeper ensemble=127.0.0.1:56089 2023-07-18 10:10:27,616 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:342210x0, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-18 10:10:27,620 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:34221-0x10177e94dcb0002 connected 2023-07-18 10:10:27,622 DEBUG [Listener at localhost/44535] zookeeper.ZKUtil(164): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-18 10:10:27,623 DEBUG [Listener at localhost/44535] zookeeper.ZKUtil(164): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 10:10:27,624 DEBUG [Listener at localhost/44535] zookeeper.ZKUtil(164): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-18 10:10:27,630 DEBUG [Listener at localhost/44535] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34221 2023-07-18 10:10:27,643 DEBUG [Listener at localhost/44535] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34221 2023-07-18 10:10:27,647 DEBUG [Listener at localhost/44535] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34221 2023-07-18 10:10:27,647 DEBUG [Listener at localhost/44535] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34221 2023-07-18 10:10:27,650 DEBUG [Listener at localhost/44535] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34221 2023-07-18 10:10:27,668 INFO [Listener at localhost/44535] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-18 10:10:27,668 INFO [Listener at localhost/44535] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 10:10:27,669 INFO [Listener at localhost/44535] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-18 10:10:27,669 INFO [Listener at localhost/44535] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-18 10:10:27,669 INFO [Listener at localhost/44535] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 10:10:27,669 INFO [Listener at localhost/44535] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-18 10:10:27,669 INFO [Listener at localhost/44535] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-18 10:10:27,671 INFO [Listener at localhost/44535] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33757 2023-07-18 10:10:27,672 INFO [Listener at localhost/44535] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-18 10:10:27,676 DEBUG [Listener at localhost/44535] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-18 10:10:27,678 INFO [Listener at localhost/44535] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 10:10:27,680 INFO [Listener at localhost/44535] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 10:10:27,683 INFO [Listener at localhost/44535] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33757 connecting to ZooKeeper ensemble=127.0.0.1:56089 2023-07-18 10:10:27,694 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:337570x0, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-18 10:10:27,695 DEBUG [Listener at localhost/44535] zookeeper.ZKUtil(164): regionserver:337570x0, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-18 10:10:27,696 DEBUG [Listener at localhost/44535] zookeeper.ZKUtil(164): regionserver:337570x0, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 10:10:27,696 DEBUG [Listener at localhost/44535] zookeeper.ZKUtil(164): regionserver:337570x0, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-18 10:10:27,699 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:33757-0x10177e94dcb0003 connected 2023-07-18 10:10:27,702 DEBUG [Listener at localhost/44535] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33757 2023-07-18 10:10:27,703 DEBUG [Listener at localhost/44535] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33757 2023-07-18 10:10:27,703 DEBUG [Listener at localhost/44535] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33757 2023-07-18 10:10:27,704 DEBUG [Listener at localhost/44535] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33757 2023-07-18 10:10:27,706 DEBUG [Listener at localhost/44535] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33757 2023-07-18 10:10:27,708 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,46557,1689675026042 2023-07-18 10:10:27,718 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-18 10:10:27,720 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,46557,1689675026042 2023-07-18 10:10:27,739 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-18 10:10:27,739 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-18 10:10:27,739 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 10:10:27,739 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-18 10:10:27,739 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-18 10:10:27,742 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-18 10:10:27,743 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-18 10:10:27,743 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,46557,1689675026042 from backup master directory 2023-07-18 10:10:27,748 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,46557,1689675026042 2023-07-18 10:10:27,748 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-18 10:10:27,749 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-18 10:10:27,749 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,46557,1689675026042 2023-07-18 10:10:27,753 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-18 10:10:27,759 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-18 10:10:27,872 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/hbase.id with ID: ae17f8af-3973-48e4-8848-bb281646873f 2023-07-18 10:10:27,925 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 10:10:27,949 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 10:10:28,038 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x6004cd9c to 127.0.0.1:56089 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 10:10:28,077 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@31050f51, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 10:10:28,107 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-18 10:10:28,109 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-18 10:10:28,135 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-18 10:10:28,135 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-18 10:10:28,138 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-18 10:10:28,144 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-18 10:10:28,145 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-18 10:10:28,189 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/MasterData/data/master/store-tmp 2023-07-18 10:10:28,262 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:10:28,262 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-18 10:10:28,262 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 10:10:28,262 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 10:10:28,262 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-18 10:10:28,262 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 10:10:28,262 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 10:10:28,262 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-18 10:10:28,264 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/MasterData/WALs/jenkins-hbase4.apache.org,46557,1689675026042 2023-07-18 10:10:28,298 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46557%2C1689675026042, suffix=, logDir=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/MasterData/WALs/jenkins-hbase4.apache.org,46557,1689675026042, archiveDir=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/MasterData/oldWALs, maxLogs=10 2023-07-18 10:10:28,380 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43765,DS-37dffcbf-8daf-4233-8778-5da521e742cb,DISK] 2023-07-18 10:10:28,380 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46263,DS-e0183efe-ee9f-4d95-af97-43af21a8f84a,DISK] 2023-07-18 10:10:28,380 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37427,DS-a3337cd2-93ed-4161-a276-2b5588811623,DISK] 2023-07-18 10:10:28,395 DEBUG [RS-EventLoopGroup-5-1] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-18 10:10:28,503 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/MasterData/WALs/jenkins-hbase4.apache.org,46557,1689675026042/jenkins-hbase4.apache.org%2C46557%2C1689675026042.1689675028313 2023-07-18 10:10:28,504 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46263,DS-e0183efe-ee9f-4d95-af97-43af21a8f84a,DISK], DatanodeInfoWithStorage[127.0.0.1:43765,DS-37dffcbf-8daf-4233-8778-5da521e742cb,DISK], DatanodeInfoWithStorage[127.0.0.1:37427,DS-a3337cd2-93ed-4161-a276-2b5588811623,DISK]] 2023-07-18 10:10:28,505 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-18 10:10:28,505 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:10:28,509 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-18 10:10:28,511 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-18 10:10:28,596 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-18 10:10:28,604 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-18 10:10:28,643 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-18 10:10:28,660 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 10:10:28,667 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-18 10:10:28,669 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-18 10:10:28,686 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-18 10:10:28,692 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 10:10:28,693 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63358311, jitterRate=-0.05588759481906891}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 10:10:28,693 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-18 10:10:28,695 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-18 10:10:28,721 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-18 10:10:28,721 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-18 10:10:28,724 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-18 10:10:28,727 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-18 10:10:28,772 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 44 msec 2023-07-18 10:10:28,772 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-18 10:10:28,803 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-18 10:10:28,809 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-18 10:10:28,837 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-18 10:10:28,842 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-18 10:10:28,843 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-18 10:10:28,851 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-18 10:10:28,857 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-18 10:10:28,861 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 10:10:28,863 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-18 10:10:28,864 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-18 10:10:28,882 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-18 10:10:28,889 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-18 10:10:28,889 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-18 10:10:28,889 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 10:10:28,889 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-18 10:10:28,889 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-18 10:10:28,891 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,46557,1689675026042, sessionid=0x10177e94dcb0000, setting cluster-up flag (Was=false) 2023-07-18 10:10:28,916 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 10:10:28,933 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-18 10:10:28,937 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,46557,1689675026042 2023-07-18 10:10:28,944 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 10:10:28,956 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-18 10:10:28,958 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,46557,1689675026042 2023-07-18 10:10:28,962 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/.tmp 2023-07-18 10:10:29,014 INFO [RS:0;jenkins-hbase4:40089] regionserver.HRegionServer(951): ClusterId : ae17f8af-3973-48e4-8848-bb281646873f 2023-07-18 10:10:29,044 INFO [RS:2;jenkins-hbase4:33757] regionserver.HRegionServer(951): ClusterId : ae17f8af-3973-48e4-8848-bb281646873f 2023-07-18 10:10:29,044 INFO [RS:1;jenkins-hbase4:34221] regionserver.HRegionServer(951): ClusterId : ae17f8af-3973-48e4-8848-bb281646873f 2023-07-18 10:10:29,060 DEBUG [RS:1;jenkins-hbase4:34221] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-18 10:10:29,060 DEBUG [RS:2;jenkins-hbase4:33757] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-18 10:10:29,060 DEBUG [RS:0;jenkins-hbase4:40089] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-18 10:10:29,078 DEBUG [RS:1;jenkins-hbase4:34221] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-18 10:10:29,078 DEBUG [RS:2;jenkins-hbase4:33757] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-18 10:10:29,078 DEBUG [RS:2;jenkins-hbase4:33757] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-18 10:10:29,078 DEBUG [RS:1;jenkins-hbase4:34221] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-18 10:10:29,078 DEBUG [RS:0;jenkins-hbase4:40089] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-18 10:10:29,079 DEBUG [RS:0;jenkins-hbase4:40089] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-18 10:10:29,085 DEBUG [RS:0;jenkins-hbase4:40089] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-18 10:10:29,085 DEBUG [RS:2;jenkins-hbase4:33757] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-18 10:10:29,087 DEBUG [RS:0;jenkins-hbase4:40089] zookeeper.ReadOnlyZKClient(139): Connect 0x1acfb8be to 127.0.0.1:56089 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 10:10:29,088 DEBUG [RS:1;jenkins-hbase4:34221] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-18 10:10:29,088 DEBUG [RS:2;jenkins-hbase4:33757] zookeeper.ReadOnlyZKClient(139): Connect 0x17494da9 to 127.0.0.1:56089 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 10:10:29,106 DEBUG [RS:1;jenkins-hbase4:34221] zookeeper.ReadOnlyZKClient(139): Connect 0x480f68d1 to 127.0.0.1:56089 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 10:10:29,116 DEBUG [RS:0;jenkins-hbase4:40089] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5f99e645, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 10:10:29,117 DEBUG [RS:0;jenkins-hbase4:40089] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4775cbd9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-18 10:10:29,124 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-18 10:10:29,129 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 10:10:29,130 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-18 10:10:29,157 DEBUG [RS:2;jenkins-hbase4:33757] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@524bd124, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 10:10:29,157 DEBUG [RS:2;jenkins-hbase4:33757] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4658a25a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-18 10:10:29,167 DEBUG [RS:1;jenkins-hbase4:34221] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@49047328, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 10:10:29,168 DEBUG [RS:1;jenkins-hbase4:34221] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c3e43cb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-18 10:10:29,180 DEBUG [RS:1;jenkins-hbase4:34221] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:34221 2023-07-18 10:10:29,180 DEBUG [RS:2;jenkins-hbase4:33757] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:33757 2023-07-18 10:10:29,191 DEBUG [RS:0;jenkins-hbase4:40089] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:40089 2023-07-18 10:10:29,195 INFO [RS:1;jenkins-hbase4:34221] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-18 10:10:29,199 INFO [RS:0;jenkins-hbase4:40089] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-18 10:10:29,199 INFO [RS:0;jenkins-hbase4:40089] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-18 10:10:29,195 INFO [RS:2;jenkins-hbase4:33757] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-18 10:10:29,199 INFO [RS:1;jenkins-hbase4:34221] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-18 10:10:29,200 DEBUG [RS:0;jenkins-hbase4:40089] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-18 10:10:29,200 DEBUG [RS:1;jenkins-hbase4:34221] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-18 10:10:29,201 INFO [RS:2;jenkins-hbase4:33757] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-18 10:10:29,201 INFO [RS:0;jenkins-hbase4:40089] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 10:10:29,203 DEBUG [RS:2;jenkins-hbase4:33757] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-18 10:10:29,203 INFO [RS:1;jenkins-hbase4:34221] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 10:10:29,203 DEBUG [RS:0;jenkins-hbase4:40089] regionserver.HRegionServer(1022): About to register with Master. 2023-07-18 10:10:29,203 INFO [RS:2;jenkins-hbase4:33757] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 10:10:29,203 DEBUG [RS:2;jenkins-hbase4:33757] regionserver.HRegionServer(1022): About to register with Master. 2023-07-18 10:10:29,203 DEBUG [RS:1;jenkins-hbase4:34221] regionserver.HRegionServer(1022): About to register with Master. 2023-07-18 10:10:29,207 INFO [RS:0;jenkins-hbase4:40089] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46557,1689675026042 with isa=jenkins-hbase4.apache.org/172.31.14.131:40089, startcode=1689675027524 2023-07-18 10:10:29,207 INFO [RS:2;jenkins-hbase4:33757] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46557,1689675026042 with isa=jenkins-hbase4.apache.org/172.31.14.131:33757, startcode=1689675027667 2023-07-18 10:10:29,207 INFO [RS:1;jenkins-hbase4:34221] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46557,1689675026042 with isa=jenkins-hbase4.apache.org/172.31.14.131:34221, startcode=1689675027589 2023-07-18 10:10:29,239 DEBUG [RS:1;jenkins-hbase4:34221] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-18 10:10:29,240 DEBUG [RS:2;jenkins-hbase4:33757] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-18 10:10:29,239 DEBUG [RS:0;jenkins-hbase4:40089] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-18 10:10:29,253 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-18 10:10:29,266 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-18 10:10:29,267 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-18 10:10:29,267 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-18 10:10:29,267 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-18 10:10:29,267 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-18 10:10:29,267 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 10:10:29,267 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-18 10:10:29,267 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 10:10:29,295 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689675059295 2023-07-18 10:10:29,306 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-18 10:10:29,312 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-18 10:10:29,313 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-18 10:10:29,319 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-18 10:10:29,330 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-18 10:10:29,331 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42807, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-18 10:10:29,333 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46513, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-18 10:10:29,332 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54085, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-18 10:10:29,341 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-18 10:10:29,344 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-18 10:10:29,344 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-18 10:10:29,344 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-18 10:10:29,348 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46557] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-18 10:10:29,355 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-18 10:10:29,358 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46557] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-18 10:10:29,359 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46557] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-18 10:10:29,367 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-18 10:10:29,369 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-18 10:10:29,370 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-18 10:10:29,375 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-18 10:10:29,376 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-18 10:10:29,377 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689675029377,5,FailOnTimeoutGroup] 2023-07-18 10:10:29,378 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689675029378,5,FailOnTimeoutGroup] 2023-07-18 10:10:29,378 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-18 10:10:29,378 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-18 10:10:29,382 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-18 10:10:29,382 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-18 10:10:29,397 DEBUG [RS:2;jenkins-hbase4:33757] regionserver.HRegionServer(2830): Master is not running yet 2023-07-18 10:10:29,397 DEBUG [RS:0;jenkins-hbase4:40089] regionserver.HRegionServer(2830): Master is not running yet 2023-07-18 10:10:29,397 WARN [RS:2;jenkins-hbase4:33757] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-18 10:10:29,397 WARN [RS:0;jenkins-hbase4:40089] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-18 10:10:29,402 DEBUG [RS:1;jenkins-hbase4:34221] regionserver.HRegionServer(2830): Master is not running yet 2023-07-18 10:10:29,403 WARN [RS:1;jenkins-hbase4:34221] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-18 10:10:29,437 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-18 10:10:29,438 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-18 10:10:29,439 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336 2023-07-18 10:10:29,470 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:10:29,473 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-18 10:10:29,477 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/hbase/meta/1588230740/info 2023-07-18 10:10:29,479 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-18 10:10:29,480 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 10:10:29,481 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-18 10:10:29,485 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/hbase/meta/1588230740/rep_barrier 2023-07-18 10:10:29,485 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-18 10:10:29,486 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 10:10:29,487 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-18 10:10:29,489 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/hbase/meta/1588230740/table 2023-07-18 10:10:29,490 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-18 10:10:29,492 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 10:10:29,493 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/hbase/meta/1588230740 2023-07-18 10:10:29,495 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/hbase/meta/1588230740 2023-07-18 10:10:29,499 INFO [RS:2;jenkins-hbase4:33757] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46557,1689675026042 with isa=jenkins-hbase4.apache.org/172.31.14.131:33757, startcode=1689675027667 2023-07-18 10:10:29,499 INFO [RS:0;jenkins-hbase4:40089] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46557,1689675026042 with isa=jenkins-hbase4.apache.org/172.31.14.131:40089, startcode=1689675027524 2023-07-18 10:10:29,505 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-18 10:10:29,507 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46557] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:29,511 INFO [RS:1;jenkins-hbase4:34221] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46557,1689675026042 with isa=jenkins-hbase4.apache.org/172.31.14.131:34221, startcode=1689675027589 2023-07-18 10:10:29,513 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46557] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:29,514 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-18 10:10:29,514 DEBUG [RS:2;jenkins-hbase4:33757] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336 2023-07-18 10:10:29,515 DEBUG [RS:2;jenkins-hbase4:33757] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:35953 2023-07-18 10:10:29,515 DEBUG [RS:2;jenkins-hbase4:33757] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-18 10:10:29,515 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46557] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:29,522 DEBUG [RS:0;jenkins-hbase4:40089] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336 2023-07-18 10:10:29,522 DEBUG [RS:1;jenkins-hbase4:34221] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336 2023-07-18 10:10:29,523 DEBUG [RS:1;jenkins-hbase4:34221] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:35953 2023-07-18 10:10:29,523 DEBUG [RS:1;jenkins-hbase4:34221] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-18 10:10:29,523 DEBUG [RS:0;jenkins-hbase4:40089] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:35953 2023-07-18 10:10:29,524 DEBUG [RS:0;jenkins-hbase4:40089] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-18 10:10:29,525 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 10:10:29,531 DEBUG [RS:1;jenkins-hbase4:34221] zookeeper.ZKUtil(162): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:29,531 DEBUG [RS:2;jenkins-hbase4:33757] zookeeper.ZKUtil(162): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:29,531 WARN [RS:1;jenkins-hbase4:34221] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-18 10:10:29,531 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 10:10:29,532 INFO [RS:1;jenkins-hbase4:34221] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-18 10:10:29,532 DEBUG [RS:0;jenkins-hbase4:40089] zookeeper.ZKUtil(162): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:29,532 DEBUG [RS:1;jenkins-hbase4:34221] regionserver.HRegionServer(1948): logDir=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/WALs/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:29,531 WARN [RS:2;jenkins-hbase4:33757] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-18 10:10:29,532 WARN [RS:0;jenkins-hbase4:40089] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-18 10:10:29,533 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64064029, jitterRate=-0.04537157714366913}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-18 10:10:29,533 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-18 10:10:29,533 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-18 10:10:29,533 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-18 10:10:29,533 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-18 10:10:29,533 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-18 10:10:29,533 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-18 10:10:29,533 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,33757,1689675027667] 2023-07-18 10:10:29,534 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40089,1689675027524] 2023-07-18 10:10:29,534 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34221,1689675027589] 2023-07-18 10:10:29,533 INFO [RS:2;jenkins-hbase4:33757] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-18 10:10:29,537 DEBUG [RS:2;jenkins-hbase4:33757] regionserver.HRegionServer(1948): logDir=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/WALs/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:29,533 INFO [RS:0;jenkins-hbase4:40089] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-18 10:10:29,539 DEBUG [RS:0;jenkins-hbase4:40089] regionserver.HRegionServer(1948): logDir=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/WALs/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:29,541 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-18 10:10:29,541 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-18 10:10:29,550 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-18 10:10:29,550 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-18 10:10:29,557 DEBUG [RS:1;jenkins-hbase4:34221] zookeeper.ZKUtil(162): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:29,558 DEBUG [RS:1;jenkins-hbase4:34221] zookeeper.ZKUtil(162): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:29,559 DEBUG [RS:1;jenkins-hbase4:34221] zookeeper.ZKUtil(162): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:29,559 DEBUG [RS:2;jenkins-hbase4:33757] zookeeper.ZKUtil(162): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:29,559 DEBUG [RS:0;jenkins-hbase4:40089] zookeeper.ZKUtil(162): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:29,560 DEBUG [RS:0;jenkins-hbase4:40089] zookeeper.ZKUtil(162): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:29,560 DEBUG [RS:0;jenkins-hbase4:40089] zookeeper.ZKUtil(162): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:29,561 DEBUG [RS:2;jenkins-hbase4:33757] zookeeper.ZKUtil(162): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:29,562 DEBUG [RS:2;jenkins-hbase4:33757] zookeeper.ZKUtil(162): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:29,565 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-18 10:10:29,587 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-18 10:10:29,588 DEBUG [RS:0;jenkins-hbase4:40089] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-18 10:10:29,591 DEBUG [RS:2;jenkins-hbase4:33757] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-18 10:10:29,591 DEBUG [RS:1;jenkins-hbase4:34221] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-18 10:10:29,595 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-18 10:10:29,602 INFO [RS:0;jenkins-hbase4:40089] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-18 10:10:29,602 INFO [RS:1;jenkins-hbase4:34221] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-18 10:10:29,602 INFO [RS:2;jenkins-hbase4:33757] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-18 10:10:29,628 INFO [RS:0;jenkins-hbase4:40089] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-18 10:10:29,631 INFO [RS:2;jenkins-hbase4:33757] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-18 10:10:29,631 INFO [RS:1;jenkins-hbase4:34221] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-18 10:10:29,638 INFO [RS:2;jenkins-hbase4:33757] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-18 10:10:29,638 INFO [RS:2;jenkins-hbase4:33757] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 10:10:29,638 INFO [RS:1;jenkins-hbase4:34221] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-18 10:10:29,638 INFO [RS:0;jenkins-hbase4:40089] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-18 10:10:29,639 INFO [RS:1;jenkins-hbase4:34221] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 10:10:29,639 INFO [RS:0;jenkins-hbase4:40089] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 10:10:29,639 INFO [RS:2;jenkins-hbase4:33757] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-18 10:10:29,642 INFO [RS:1;jenkins-hbase4:34221] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-18 10:10:29,642 INFO [RS:0;jenkins-hbase4:40089] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-18 10:10:29,651 INFO [RS:1;jenkins-hbase4:34221] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-18 10:10:29,651 INFO [RS:2;jenkins-hbase4:33757] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-18 10:10:29,651 INFO [RS:0;jenkins-hbase4:40089] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-18 10:10:29,651 DEBUG [RS:1;jenkins-hbase4:34221] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 10:10:29,651 DEBUG [RS:2;jenkins-hbase4:33757] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 10:10:29,652 DEBUG [RS:1;jenkins-hbase4:34221] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 10:10:29,652 DEBUG [RS:2;jenkins-hbase4:33757] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 10:10:29,652 DEBUG [RS:1;jenkins-hbase4:34221] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 10:10:29,652 DEBUG [RS:2;jenkins-hbase4:33757] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 10:10:29,652 DEBUG [RS:1;jenkins-hbase4:34221] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 10:10:29,652 DEBUG [RS:2;jenkins-hbase4:33757] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 10:10:29,653 DEBUG [RS:1;jenkins-hbase4:34221] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 10:10:29,653 DEBUG [RS:2;jenkins-hbase4:33757] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 10:10:29,653 DEBUG [RS:1;jenkins-hbase4:34221] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-18 10:10:29,653 DEBUG [RS:2;jenkins-hbase4:33757] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-18 10:10:29,653 DEBUG [RS:1;jenkins-hbase4:34221] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 10:10:29,653 DEBUG [RS:2;jenkins-hbase4:33757] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 10:10:29,652 DEBUG [RS:0;jenkins-hbase4:40089] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 10:10:29,653 DEBUG [RS:1;jenkins-hbase4:34221] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 10:10:29,653 DEBUG [RS:0;jenkins-hbase4:40089] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 10:10:29,653 DEBUG [RS:1;jenkins-hbase4:34221] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 10:10:29,653 DEBUG [RS:0;jenkins-hbase4:40089] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 10:10:29,653 DEBUG [RS:1;jenkins-hbase4:34221] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 10:10:29,654 DEBUG [RS:0;jenkins-hbase4:40089] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 10:10:29,653 DEBUG [RS:2;jenkins-hbase4:33757] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 10:10:29,654 DEBUG [RS:0;jenkins-hbase4:40089] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 10:10:29,654 DEBUG [RS:2;jenkins-hbase4:33757] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 10:10:29,654 DEBUG [RS:0;jenkins-hbase4:40089] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-18 10:10:29,654 DEBUG [RS:2;jenkins-hbase4:33757] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 10:10:29,654 DEBUG [RS:0;jenkins-hbase4:40089] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 10:10:29,654 DEBUG [RS:0;jenkins-hbase4:40089] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 10:10:29,654 DEBUG [RS:0;jenkins-hbase4:40089] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 10:10:29,654 DEBUG [RS:0;jenkins-hbase4:40089] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 10:10:29,660 INFO [RS:1;jenkins-hbase4:34221] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-18 10:10:29,660 INFO [RS:1;jenkins-hbase4:34221] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-18 10:10:29,660 INFO [RS:1;jenkins-hbase4:34221] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-18 10:10:29,667 INFO [RS:0;jenkins-hbase4:40089] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-18 10:10:29,667 INFO [RS:0;jenkins-hbase4:40089] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-18 10:10:29,667 INFO [RS:0;jenkins-hbase4:40089] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-18 10:10:29,668 INFO [RS:2;jenkins-hbase4:33757] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-18 10:10:29,668 INFO [RS:2;jenkins-hbase4:33757] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-18 10:10:29,668 INFO [RS:2;jenkins-hbase4:33757] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-18 10:10:29,683 INFO [RS:1;jenkins-hbase4:34221] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-18 10:10:29,683 INFO [RS:0;jenkins-hbase4:40089] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-18 10:10:29,687 INFO [RS:1;jenkins-hbase4:34221] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34221,1689675027589-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 10:10:29,687 INFO [RS:0;jenkins-hbase4:40089] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40089,1689675027524-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 10:10:29,718 INFO [RS:2;jenkins-hbase4:33757] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-18 10:10:29,718 INFO [RS:2;jenkins-hbase4:33757] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33757,1689675027667-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 10:10:29,742 INFO [RS:0;jenkins-hbase4:40089] regionserver.Replication(203): jenkins-hbase4.apache.org,40089,1689675027524 started 2023-07-18 10:10:29,742 INFO [RS:0;jenkins-hbase4:40089] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,40089,1689675027524, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40089, sessionid=0x10177e94dcb0001 2023-07-18 10:10:29,743 DEBUG [RS:0;jenkins-hbase4:40089] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-18 10:10:29,743 DEBUG [RS:0;jenkins-hbase4:40089] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:29,743 DEBUG [RS:0;jenkins-hbase4:40089] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40089,1689675027524' 2023-07-18 10:10:29,743 DEBUG [RS:0;jenkins-hbase4:40089] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-18 10:10:29,744 DEBUG [RS:0;jenkins-hbase4:40089] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-18 10:10:29,745 DEBUG [RS:0;jenkins-hbase4:40089] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-18 10:10:29,745 DEBUG [RS:0;jenkins-hbase4:40089] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-18 10:10:29,745 DEBUG [RS:0;jenkins-hbase4:40089] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:29,745 DEBUG [RS:0;jenkins-hbase4:40089] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40089,1689675027524' 2023-07-18 10:10:29,745 DEBUG [RS:0;jenkins-hbase4:40089] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:10:29,748 DEBUG [jenkins-hbase4:46557] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-18 10:10:29,751 DEBUG [RS:0;jenkins-hbase4:40089] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:10:29,752 DEBUG [RS:0;jenkins-hbase4:40089] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-18 10:10:29,752 INFO [RS:0;jenkins-hbase4:40089] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-18 10:10:29,752 INFO [RS:0;jenkins-hbase4:40089] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-18 10:10:29,753 DEBUG [jenkins-hbase4:46557] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 10:10:29,755 INFO [RS:1;jenkins-hbase4:34221] regionserver.Replication(203): jenkins-hbase4.apache.org,34221,1689675027589 started 2023-07-18 10:10:29,755 INFO [RS:1;jenkins-hbase4:34221] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,34221,1689675027589, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34221, sessionid=0x10177e94dcb0002 2023-07-18 10:10:29,755 DEBUG [RS:1;jenkins-hbase4:34221] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-18 10:10:29,755 DEBUG [RS:1;jenkins-hbase4:34221] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:29,758 DEBUG [RS:1;jenkins-hbase4:34221] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34221,1689675027589' 2023-07-18 10:10:29,760 DEBUG [RS:1;jenkins-hbase4:34221] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-18 10:10:29,761 DEBUG [RS:1;jenkins-hbase4:34221] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-18 10:10:29,761 DEBUG [RS:1;jenkins-hbase4:34221] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-18 10:10:29,761 DEBUG [RS:1;jenkins-hbase4:34221] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-18 10:10:29,761 DEBUG [RS:1;jenkins-hbase4:34221] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:29,762 DEBUG [RS:1;jenkins-hbase4:34221] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34221,1689675027589' 2023-07-18 10:10:29,762 DEBUG [RS:1;jenkins-hbase4:34221] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:10:29,763 DEBUG [RS:1;jenkins-hbase4:34221] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:10:29,764 DEBUG [RS:1;jenkins-hbase4:34221] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-18 10:10:29,764 INFO [RS:1;jenkins-hbase4:34221] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-18 10:10:29,764 INFO [RS:1;jenkins-hbase4:34221] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-18 10:10:29,769 DEBUG [jenkins-hbase4:46557] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 10:10:29,769 DEBUG [jenkins-hbase4:46557] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 10:10:29,769 DEBUG [jenkins-hbase4:46557] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 10:10:29,769 DEBUG [jenkins-hbase4:46557] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 10:10:29,772 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40089,1689675027524, state=OPENING 2023-07-18 10:10:29,773 INFO [RS:2;jenkins-hbase4:33757] regionserver.Replication(203): jenkins-hbase4.apache.org,33757,1689675027667 started 2023-07-18 10:10:29,773 INFO [RS:2;jenkins-hbase4:33757] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,33757,1689675027667, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:33757, sessionid=0x10177e94dcb0003 2023-07-18 10:10:29,773 DEBUG [RS:2;jenkins-hbase4:33757] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-18 10:10:29,773 DEBUG [RS:2;jenkins-hbase4:33757] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:29,773 DEBUG [RS:2;jenkins-hbase4:33757] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33757,1689675027667' 2023-07-18 10:10:29,773 DEBUG [RS:2;jenkins-hbase4:33757] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-18 10:10:29,774 DEBUG [RS:2;jenkins-hbase4:33757] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-18 10:10:29,774 DEBUG [RS:2;jenkins-hbase4:33757] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-18 10:10:29,774 DEBUG [RS:2;jenkins-hbase4:33757] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-18 10:10:29,774 DEBUG [RS:2;jenkins-hbase4:33757] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:29,774 DEBUG [RS:2;jenkins-hbase4:33757] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33757,1689675027667' 2023-07-18 10:10:29,775 DEBUG [RS:2;jenkins-hbase4:33757] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:10:29,775 DEBUG [RS:2;jenkins-hbase4:33757] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:10:29,775 DEBUG [RS:2;jenkins-hbase4:33757] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-18 10:10:29,776 INFO [RS:2;jenkins-hbase4:33757] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-18 10:10:29,776 INFO [RS:2;jenkins-hbase4:33757] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-18 10:10:29,782 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-18 10:10:29,784 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 10:10:29,785 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-18 10:10:29,790 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40089,1689675027524}] 2023-07-18 10:10:29,868 INFO [RS:0;jenkins-hbase4:40089] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40089%2C1689675027524, suffix=, logDir=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/WALs/jenkins-hbase4.apache.org,40089,1689675027524, archiveDir=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/oldWALs, maxLogs=32 2023-07-18 10:10:29,869 INFO [RS:1;jenkins-hbase4:34221] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34221%2C1689675027589, suffix=, logDir=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/WALs/jenkins-hbase4.apache.org,34221,1689675027589, archiveDir=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/oldWALs, maxLogs=32 2023-07-18 10:10:29,879 INFO [RS:2;jenkins-hbase4:33757] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33757%2C1689675027667, suffix=, logDir=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/WALs/jenkins-hbase4.apache.org,33757,1689675027667, archiveDir=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/oldWALs, maxLogs=32 2023-07-18 10:10:29,948 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37427,DS-a3337cd2-93ed-4161-a276-2b5588811623,DISK] 2023-07-18 10:10:29,948 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46263,DS-e0183efe-ee9f-4d95-af97-43af21a8f84a,DISK] 2023-07-18 10:10:29,949 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46263,DS-e0183efe-ee9f-4d95-af97-43af21a8f84a,DISK] 2023-07-18 10:10:29,949 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37427,DS-a3337cd2-93ed-4161-a276-2b5588811623,DISK] 2023-07-18 10:10:29,949 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43765,DS-37dffcbf-8daf-4233-8778-5da521e742cb,DISK] 2023-07-18 10:10:29,949 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43765,DS-37dffcbf-8daf-4233-8778-5da521e742cb,DISK] 2023-07-18 10:10:29,951 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46263,DS-e0183efe-ee9f-4d95-af97-43af21a8f84a,DISK] 2023-07-18 10:10:29,959 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37427,DS-a3337cd2-93ed-4161-a276-2b5588811623,DISK] 2023-07-18 10:10:29,959 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43765,DS-37dffcbf-8daf-4233-8778-5da521e742cb,DISK] 2023-07-18 10:10:29,987 INFO [RS:1;jenkins-hbase4:34221] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/WALs/jenkins-hbase4.apache.org,34221,1689675027589/jenkins-hbase4.apache.org%2C34221%2C1689675027589.1689675029873 2023-07-18 10:10:29,987 INFO [RS:0;jenkins-hbase4:40089] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/WALs/jenkins-hbase4.apache.org,40089,1689675027524/jenkins-hbase4.apache.org%2C40089%2C1689675027524.1689675029873 2023-07-18 10:10:29,987 INFO [RS:2;jenkins-hbase4:33757] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/WALs/jenkins-hbase4.apache.org,33757,1689675027667/jenkins-hbase4.apache.org%2C33757%2C1689675027667.1689675029881 2023-07-18 10:10:29,990 DEBUG [RS:1;jenkins-hbase4:34221] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46263,DS-e0183efe-ee9f-4d95-af97-43af21a8f84a,DISK], DatanodeInfoWithStorage[127.0.0.1:37427,DS-a3337cd2-93ed-4161-a276-2b5588811623,DISK], DatanodeInfoWithStorage[127.0.0.1:43765,DS-37dffcbf-8daf-4233-8778-5da521e742cb,DISK]] 2023-07-18 10:10:29,992 DEBUG [RS:2;jenkins-hbase4:33757] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43765,DS-37dffcbf-8daf-4233-8778-5da521e742cb,DISK], DatanodeInfoWithStorage[127.0.0.1:46263,DS-e0183efe-ee9f-4d95-af97-43af21a8f84a,DISK], DatanodeInfoWithStorage[127.0.0.1:37427,DS-a3337cd2-93ed-4161-a276-2b5588811623,DISK]] 2023-07-18 10:10:29,992 DEBUG [RS:0;jenkins-hbase4:40089] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46263,DS-e0183efe-ee9f-4d95-af97-43af21a8f84a,DISK], DatanodeInfoWithStorage[127.0.0.1:43765,DS-37dffcbf-8daf-4233-8778-5da521e742cb,DISK], DatanodeInfoWithStorage[127.0.0.1:37427,DS-a3337cd2-93ed-4161-a276-2b5588811623,DISK]] 2023-07-18 10:10:30,007 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:30,009 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-18 10:10:30,025 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54840, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-18 10:10:30,041 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-18 10:10:30,042 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-18 10:10:30,045 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40089%2C1689675027524.meta, suffix=.meta, logDir=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/WALs/jenkins-hbase4.apache.org,40089,1689675027524, archiveDir=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/oldWALs, maxLogs=32 2023-07-18 10:10:30,079 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43765,DS-37dffcbf-8daf-4233-8778-5da521e742cb,DISK] 2023-07-18 10:10:30,081 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37427,DS-a3337cd2-93ed-4161-a276-2b5588811623,DISK] 2023-07-18 10:10:30,089 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46263,DS-e0183efe-ee9f-4d95-af97-43af21a8f84a,DISK] 2023-07-18 10:10:30,099 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/WALs/jenkins-hbase4.apache.org,40089,1689675027524/jenkins-hbase4.apache.org%2C40089%2C1689675027524.meta.1689675030046.meta 2023-07-18 10:10:30,101 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43765,DS-37dffcbf-8daf-4233-8778-5da521e742cb,DISK], DatanodeInfoWithStorage[127.0.0.1:37427,DS-a3337cd2-93ed-4161-a276-2b5588811623,DISK], DatanodeInfoWithStorage[127.0.0.1:46263,DS-e0183efe-ee9f-4d95-af97-43af21a8f84a,DISK]] 2023-07-18 10:10:30,101 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-18 10:10:30,103 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-18 10:10:30,105 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 10:10:30,106 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-18 10:10:30,108 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-18 10:10:30,110 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-18 10:10:30,128 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-18 10:10:30,129 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:10:30,129 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-18 10:10:30,129 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-18 10:10:30,132 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-18 10:10:30,134 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/hbase/meta/1588230740/info 2023-07-18 10:10:30,134 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/hbase/meta/1588230740/info 2023-07-18 10:10:30,135 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-18 10:10:30,136 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 10:10:30,136 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-18 10:10:30,139 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/hbase/meta/1588230740/rep_barrier 2023-07-18 10:10:30,139 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/hbase/meta/1588230740/rep_barrier 2023-07-18 10:10:30,139 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-18 10:10:30,141 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 10:10:30,141 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-18 10:10:30,143 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/hbase/meta/1588230740/table 2023-07-18 10:10:30,143 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/hbase/meta/1588230740/table 2023-07-18 10:10:30,143 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-18 10:10:30,144 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 10:10:30,147 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/hbase/meta/1588230740 2023-07-18 10:10:30,150 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/hbase/meta/1588230740 2023-07-18 10:10:30,154 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-18 10:10:30,157 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-18 10:10:30,159 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65231091, jitterRate=-0.027980998158454895}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-18 10:10:30,162 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-18 10:10:30,179 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689675029997 2023-07-18 10:10:30,204 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-18 10:10:30,206 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-18 10:10:30,206 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40089,1689675027524, state=OPEN 2023-07-18 10:10:30,209 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-18 10:10:30,209 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-18 10:10:30,216 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-18 10:10:30,216 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40089,1689675027524 in 419 msec 2023-07-18 10:10:30,232 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-18 10:10:30,232 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 654 msec 2023-07-18 10:10:30,245 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.1010 sec 2023-07-18 10:10:30,245 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689675030245, completionTime=-1 2023-07-18 10:10:30,245 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-18 10:10:30,246 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-18 10:10:30,317 DEBUG [hconnection-0x56f36059-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:10:30,320 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59742, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:10:30,352 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-18 10:10:30,352 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689675090352 2023-07-18 10:10:30,353 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689675150353 2023-07-18 10:10:30,353 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 106 msec 2023-07-18 10:10:30,382 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46557,1689675026042-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 10:10:30,382 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46557,1689675026042-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-18 10:10:30,382 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46557,1689675026042-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-18 10:10:30,385 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:46557, period=300000, unit=MILLISECONDS is enabled. 2023-07-18 10:10:30,385 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-18 10:10:30,394 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-18 10:10:30,403 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-18 10:10:30,404 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-18 10:10:30,416 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-18 10:10:30,427 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 10:10:30,444 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 10:10:30,487 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/hbase/namespace/d12cce108623bd7aaeb840f9208d7c33 2023-07-18 10:10:30,502 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/hbase/namespace/d12cce108623bd7aaeb840f9208d7c33 empty. 2023-07-18 10:10:30,503 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/hbase/namespace/d12cce108623bd7aaeb840f9208d7c33 2023-07-18 10:10:30,503 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-18 10:10:30,571 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-18 10:10:30,574 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => d12cce108623bd7aaeb840f9208d7c33, NAME => 'hbase:namespace,,1689675030404.d12cce108623bd7aaeb840f9208d7c33.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp 2023-07-18 10:10:30,597 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689675030404.d12cce108623bd7aaeb840f9208d7c33.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:10:30,598 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing d12cce108623bd7aaeb840f9208d7c33, disabling compactions & flushes 2023-07-18 10:10:30,598 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689675030404.d12cce108623bd7aaeb840f9208d7c33. 2023-07-18 10:10:30,598 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689675030404.d12cce108623bd7aaeb840f9208d7c33. 2023-07-18 10:10:30,598 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689675030404.d12cce108623bd7aaeb840f9208d7c33. after waiting 0 ms 2023-07-18 10:10:30,598 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689675030404.d12cce108623bd7aaeb840f9208d7c33. 2023-07-18 10:10:30,598 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689675030404.d12cce108623bd7aaeb840f9208d7c33. 2023-07-18 10:10:30,598 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for d12cce108623bd7aaeb840f9208d7c33: 2023-07-18 10:10:30,605 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 10:10:30,621 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689675030404.d12cce108623bd7aaeb840f9208d7c33.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689675030608"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689675030608"}]},"ts":"1689675030608"} 2023-07-18 10:10:30,655 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-18 10:10:30,660 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 10:10:30,667 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689675030661"}]},"ts":"1689675030661"} 2023-07-18 10:10:30,673 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-18 10:10:30,681 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 10:10:30,682 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 10:10:30,682 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 10:10:30,682 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 10:10:30,682 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 10:10:30,685 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=d12cce108623bd7aaeb840f9208d7c33, ASSIGN}] 2023-07-18 10:10:30,689 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=d12cce108623bd7aaeb840f9208d7c33, ASSIGN 2023-07-18 10:10:30,691 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=d12cce108623bd7aaeb840f9208d7c33, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34221,1689675027589; forceNewPlan=false, retain=false 2023-07-18 10:10:30,844 INFO [jenkins-hbase4:46557] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-18 10:10:30,846 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=d12cce108623bd7aaeb840f9208d7c33, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:30,846 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689675030404.d12cce108623bd7aaeb840f9208d7c33.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689675030845"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689675030845"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689675030845"}]},"ts":"1689675030845"} 2023-07-18 10:10:30,852 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure d12cce108623bd7aaeb840f9208d7c33, server=jenkins-hbase4.apache.org,34221,1689675027589}] 2023-07-18 10:10:31,018 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:31,018 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-18 10:10:31,023 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48282, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-18 10:10:31,030 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689675030404.d12cce108623bd7aaeb840f9208d7c33. 2023-07-18 10:10:31,031 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d12cce108623bd7aaeb840f9208d7c33, NAME => 'hbase:namespace,,1689675030404.d12cce108623bd7aaeb840f9208d7c33.', STARTKEY => '', ENDKEY => ''} 2023-07-18 10:10:31,031 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689675030404.d12cce108623bd7aaeb840f9208d7c33. service=AccessControlService 2023-07-18 10:10:31,032 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 10:10:31,033 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace d12cce108623bd7aaeb840f9208d7c33 2023-07-18 10:10:31,033 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689675030404.d12cce108623bd7aaeb840f9208d7c33.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:10:31,033 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d12cce108623bd7aaeb840f9208d7c33 2023-07-18 10:10:31,033 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d12cce108623bd7aaeb840f9208d7c33 2023-07-18 10:10:31,036 INFO [StoreOpener-d12cce108623bd7aaeb840f9208d7c33-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region d12cce108623bd7aaeb840f9208d7c33 2023-07-18 10:10:31,039 DEBUG [StoreOpener-d12cce108623bd7aaeb840f9208d7c33-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/hbase/namespace/d12cce108623bd7aaeb840f9208d7c33/info 2023-07-18 10:10:31,039 DEBUG [StoreOpener-d12cce108623bd7aaeb840f9208d7c33-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/hbase/namespace/d12cce108623bd7aaeb840f9208d7c33/info 2023-07-18 10:10:31,040 INFO [StoreOpener-d12cce108623bd7aaeb840f9208d7c33-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d12cce108623bd7aaeb840f9208d7c33 columnFamilyName info 2023-07-18 10:10:31,041 INFO [StoreOpener-d12cce108623bd7aaeb840f9208d7c33-1] regionserver.HStore(310): Store=d12cce108623bd7aaeb840f9208d7c33/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 10:10:31,043 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/hbase/namespace/d12cce108623bd7aaeb840f9208d7c33 2023-07-18 10:10:31,046 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/hbase/namespace/d12cce108623bd7aaeb840f9208d7c33 2023-07-18 10:10:31,051 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d12cce108623bd7aaeb840f9208d7c33 2023-07-18 10:10:31,055 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/hbase/namespace/d12cce108623bd7aaeb840f9208d7c33/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 10:10:31,056 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d12cce108623bd7aaeb840f9208d7c33; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74102617, jitterRate=0.10421504080295563}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 10:10:31,056 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d12cce108623bd7aaeb840f9208d7c33: 2023-07-18 10:10:31,062 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689675030404.d12cce108623bd7aaeb840f9208d7c33., pid=6, masterSystemTime=1689675031018 2023-07-18 10:10:31,068 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689675030404.d12cce108623bd7aaeb840f9208d7c33. 2023-07-18 10:10:31,069 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689675030404.d12cce108623bd7aaeb840f9208d7c33. 2023-07-18 10:10:31,071 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=d12cce108623bd7aaeb840f9208d7c33, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:31,071 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689675030404.d12cce108623bd7aaeb840f9208d7c33.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689675031070"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689675031070"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689675031070"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689675031070"}]},"ts":"1689675031070"} 2023-07-18 10:10:31,089 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-18 10:10:31,089 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure d12cce108623bd7aaeb840f9208d7c33, server=jenkins-hbase4.apache.org,34221,1689675027589 in 226 msec 2023-07-18 10:10:31,093 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-18 10:10:31,094 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=d12cce108623bd7aaeb840f9208d7c33, ASSIGN in 404 msec 2023-07-18 10:10:31,095 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 10:10:31,095 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689675031095"}]},"ts":"1689675031095"} 2023-07-18 10:10:31,098 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-18 10:10:31,101 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 10:10:31,104 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 696 msec 2023-07-18 10:10:31,119 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-18 10:10:31,121 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-18 10:10:31,121 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 10:10:31,144 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:10:31,147 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48298, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:10:31,166 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-18 10:10:31,192 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-18 10:10:31,201 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 46 msec 2023-07-18 10:10:31,212 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-18 10:10:31,226 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-18 10:10:31,232 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 20 msec 2023-07-18 10:10:31,240 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-18 10:10:31,243 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-18 10:10:31,243 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.494sec 2023-07-18 10:10:31,247 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-18 10:10:31,249 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-18 10:10:31,249 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-18 10:10:31,251 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46557,1689675026042-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-18 10:10:31,251 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46557,1689675026042-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-18 10:10:31,253 DEBUG [Listener at localhost/44535] zookeeper.ReadOnlyZKClient(139): Connect 0x4d69ecc8 to 127.0.0.1:56089 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 10:10:31,271 DEBUG [Listener at localhost/44535] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@76a534fc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 10:10:31,284 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-18 10:10:31,287 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-18 10:10:31,291 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 10:10:31,294 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 10:10:31,297 DEBUG [hconnection-0x78d66f84-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:10:31,298 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-18 10:10:31,305 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-18 10:10:31,311 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/hbase/acl/6d59a9d97afe79d21eaa1866a4004a5e 2023-07-18 10:10:31,312 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/hbase/acl/6d59a9d97afe79d21eaa1866a4004a5e empty. 2023-07-18 10:10:31,315 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/hbase/acl/6d59a9d97afe79d21eaa1866a4004a5e 2023-07-18 10:10:31,316 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-18 10:10:31,325 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59756, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:10:31,330 INFO [Listener at localhost/44535] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,46557,1689675026042 2023-07-18 10:10:31,330 INFO [Listener at localhost/44535] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-18 10:10:31,330 INFO [Listener at localhost/44535] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/test.cache.data in system properties and HBase conf 2023-07-18 10:10:31,330 INFO [Listener at localhost/44535] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/hadoop.tmp.dir in system properties and HBase conf 2023-07-18 10:10:31,330 INFO [Listener at localhost/44535] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/hadoop.log.dir in system properties and HBase conf 2023-07-18 10:10:31,331 INFO [Listener at localhost/44535] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-18 10:10:31,331 INFO [Listener at localhost/44535] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-18 10:10:31,331 INFO [Listener at localhost/44535] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-18 10:10:31,331 INFO [Listener at localhost/44535] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-18 10:10:31,331 INFO [Listener at localhost/44535] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-18 10:10:31,331 INFO [Listener at localhost/44535] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-18 10:10:31,331 INFO [Listener at localhost/44535] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-18 10:10:31,332 INFO [Listener at localhost/44535] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-18 10:10:31,332 INFO [Listener at localhost/44535] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-18 10:10:31,332 INFO [Listener at localhost/44535] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-18 10:10:31,332 INFO [Listener at localhost/44535] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-18 10:10:31,332 INFO [Listener at localhost/44535] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-18 10:10:31,332 INFO [Listener at localhost/44535] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/nfs.dump.dir in system properties and HBase conf 2023-07-18 10:10:31,332 INFO [Listener at localhost/44535] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/java.io.tmpdir in system properties and HBase conf 2023-07-18 10:10:31,332 INFO [Listener at localhost/44535] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-18 10:10:31,332 INFO [Listener at localhost/44535] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-18 10:10:31,332 INFO [Listener at localhost/44535] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-18 10:10:31,400 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-18 10:10:31,403 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6d59a9d97afe79d21eaa1866a4004a5e, NAME => 'hbase:acl,,1689675031272.6d59a9d97afe79d21eaa1866a4004a5e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp 2023-07-18 10:10:31,408 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-18 10:10:31,482 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689675031272.6d59a9d97afe79d21eaa1866a4004a5e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:10:31,483 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 6d59a9d97afe79d21eaa1866a4004a5e, disabling compactions & flushes 2023-07-18 10:10:31,483 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689675031272.6d59a9d97afe79d21eaa1866a4004a5e. 2023-07-18 10:10:31,483 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689675031272.6d59a9d97afe79d21eaa1866a4004a5e. 2023-07-18 10:10:31,483 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689675031272.6d59a9d97afe79d21eaa1866a4004a5e. after waiting 0 ms 2023-07-18 10:10:31,483 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689675031272.6d59a9d97afe79d21eaa1866a4004a5e. 2023-07-18 10:10:31,483 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689675031272.6d59a9d97afe79d21eaa1866a4004a5e. 2023-07-18 10:10:31,483 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 6d59a9d97afe79d21eaa1866a4004a5e: 2023-07-18 10:10:31,494 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 10:10:31,497 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689675031272.6d59a9d97afe79d21eaa1866a4004a5e.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689675031496"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689675031496"}]},"ts":"1689675031496"} 2023-07-18 10:10:31,501 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-18 10:10:31,502 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 10:10:31,503 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689675031502"}]},"ts":"1689675031502"} 2023-07-18 10:10:31,507 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-18 10:10:31,515 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 10:10:31,518 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 10:10:31,518 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 10:10:31,518 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 10:10:31,518 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 10:10:31,519 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=6d59a9d97afe79d21eaa1866a4004a5e, ASSIGN}] 2023-07-18 10:10:31,526 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=6d59a9d97afe79d21eaa1866a4004a5e, ASSIGN 2023-07-18 10:10:31,529 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=6d59a9d97afe79d21eaa1866a4004a5e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34221,1689675027589; forceNewPlan=false, retain=false 2023-07-18 10:10:31,609 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-18 10:10:31,723 INFO [jenkins-hbase4:46557] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-18 10:10:31,725 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=6d59a9d97afe79d21eaa1866a4004a5e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:31,725 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689675031272.6d59a9d97afe79d21eaa1866a4004a5e.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689675031725"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689675031725"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689675031725"}]},"ts":"1689675031725"} 2023-07-18 10:10:31,740 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 6d59a9d97afe79d21eaa1866a4004a5e, server=jenkins-hbase4.apache.org,34221,1689675027589}] 2023-07-18 10:10:31,904 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689675031272.6d59a9d97afe79d21eaa1866a4004a5e. 2023-07-18 10:10:31,905 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6d59a9d97afe79d21eaa1866a4004a5e, NAME => 'hbase:acl,,1689675031272.6d59a9d97afe79d21eaa1866a4004a5e.', STARTKEY => '', ENDKEY => ''} 2023-07-18 10:10:31,906 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689675031272.6d59a9d97afe79d21eaa1866a4004a5e. service=AccessControlService 2023-07-18 10:10:31,906 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 10:10:31,906 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 6d59a9d97afe79d21eaa1866a4004a5e 2023-07-18 10:10:31,906 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689675031272.6d59a9d97afe79d21eaa1866a4004a5e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:10:31,906 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6d59a9d97afe79d21eaa1866a4004a5e 2023-07-18 10:10:31,907 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6d59a9d97afe79d21eaa1866a4004a5e 2023-07-18 10:10:31,909 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-18 10:10:31,924 INFO [StoreOpener-6d59a9d97afe79d21eaa1866a4004a5e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 6d59a9d97afe79d21eaa1866a4004a5e 2023-07-18 10:10:31,929 DEBUG [StoreOpener-6d59a9d97afe79d21eaa1866a4004a5e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/hbase/acl/6d59a9d97afe79d21eaa1866a4004a5e/l 2023-07-18 10:10:31,929 DEBUG [StoreOpener-6d59a9d97afe79d21eaa1866a4004a5e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/hbase/acl/6d59a9d97afe79d21eaa1866a4004a5e/l 2023-07-18 10:10:31,931 INFO [StoreOpener-6d59a9d97afe79d21eaa1866a4004a5e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6d59a9d97afe79d21eaa1866a4004a5e columnFamilyName l 2023-07-18 10:10:31,934 INFO [StoreOpener-6d59a9d97afe79d21eaa1866a4004a5e-1] regionserver.HStore(310): Store=6d59a9d97afe79d21eaa1866a4004a5e/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 10:10:31,938 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/hbase/acl/6d59a9d97afe79d21eaa1866a4004a5e 2023-07-18 10:10:31,939 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/hbase/acl/6d59a9d97afe79d21eaa1866a4004a5e 2023-07-18 10:10:31,947 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6d59a9d97afe79d21eaa1866a4004a5e 2023-07-18 10:10:31,952 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/hbase/acl/6d59a9d97afe79d21eaa1866a4004a5e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 10:10:31,954 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6d59a9d97afe79d21eaa1866a4004a5e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60697482, jitterRate=-0.09553703665733337}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 10:10:31,954 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6d59a9d97afe79d21eaa1866a4004a5e: 2023-07-18 10:10:31,956 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689675031272.6d59a9d97afe79d21eaa1866a4004a5e., pid=11, masterSystemTime=1689675031895 2023-07-18 10:10:31,959 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689675031272.6d59a9d97afe79d21eaa1866a4004a5e. 2023-07-18 10:10:31,960 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689675031272.6d59a9d97afe79d21eaa1866a4004a5e. 2023-07-18 10:10:31,961 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=6d59a9d97afe79d21eaa1866a4004a5e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:31,961 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689675031272.6d59a9d97afe79d21eaa1866a4004a5e.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689675031960"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689675031960"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689675031960"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689675031960"}]},"ts":"1689675031960"} 2023-07-18 10:10:31,976 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-18 10:10:31,976 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 6d59a9d97afe79d21eaa1866a4004a5e, server=jenkins-hbase4.apache.org,34221,1689675027589 in 226 msec 2023-07-18 10:10:31,983 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-18 10:10:31,983 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=6d59a9d97afe79d21eaa1866a4004a5e, ASSIGN in 458 msec 2023-07-18 10:10:31,984 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 10:10:31,985 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689675031985"}]},"ts":"1689675031985"} 2023-07-18 10:10:31,987 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-18 10:10:31,991 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 10:10:31,997 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 706 msec 2023-07-18 10:10:32,409 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-18 10:10:32,410 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-18 10:10:32,428 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-18 10:10:32,853 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-18 10:10:33,154 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-07-18 10:10:33,161 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_46697_jobhistory____.psqyx1/webapp 2023-07-18 10:10:33,349 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-18 10:10:33,349 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-18 10:10:33,349 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-18 10:10:33,352 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-18 10:10:33,426 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 10:10:33,710 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 10:10:34,078 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-18 10:10:34,166 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:46697 2023-07-18 10:10:34,363 WARN [Listener at jenkins-hbase4.apache.org/44747] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-18 10:10:34,839 WARN [Listener at jenkins-hbase4.apache.org/44747] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-18 10:10:34,840 INFO [Listener at jenkins-hbase4.apache.org/44747] log.Slf4jLog(67): jetty-6.1.26 2023-07-18 10:10:34,859 INFO [Listener at jenkins-hbase4.apache.org/44747] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_33393_cluster____.c9li21/webapp 2023-07-18 10:10:34,937 INFO [Listener at jenkins-hbase4.apache.org/44747] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-18 10:10:34,938 INFO [Listener at jenkins-hbase4.apache.org/44747] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-18 10:10:34,938 INFO [Listener at jenkins-hbase4.apache.org/44747] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-18 10:10:34,938 INFO [Listener at jenkins-hbase4.apache.org/44747] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-18 10:10:34,950 INFO [Listener at jenkins-hbase4.apache.org/44747] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 10:10:35,298 INFO [Listener at jenkins-hbase4.apache.org/44747] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 10:10:35,532 INFO [Listener at jenkins-hbase4.apache.org/44747] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 10:10:35,556 INFO [Listener at jenkins-hbase4.apache.org/44747] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:33393 2023-07-18 10:10:35,856 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-18 10:10:35,996 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-18 10:10:35,998 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-18 10:10:36,001 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-18 10:10:36,223 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 10:10:36,224 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-18 10:10:36,224 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 10:10:36,225 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-18 10:10:36,225 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-18 10:10:36,225 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-18 10:10:36,225 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 10:10:36,225 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-18 10:10:36,225 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-18 10:10:36,225 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-18 10:10:36,256 WARN [Listener at jenkins-hbase4.apache.org/43719] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-18 10:10:36,284 WARN [Listener at jenkins-hbase4.apache.org/43719] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-18 10:10:36,284 INFO [Listener at jenkins-hbase4.apache.org/43719] log.Slf4jLog(67): jetty-6.1.26 2023-07-18 10:10:36,291 INFO [Listener at jenkins-hbase4.apache.org/43719] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_46001_node____trh5t9/webapp 2023-07-18 10:10:36,354 INFO [Listener at jenkins-hbase4.apache.org/43719] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-18 10:10:36,354 INFO [Listener at jenkins-hbase4.apache.org/43719] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-18 10:10:36,354 INFO [Listener at jenkins-hbase4.apache.org/43719] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-18 10:10:36,354 INFO [Listener at jenkins-hbase4.apache.org/43719] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-18 10:10:36,361 INFO [Listener at jenkins-hbase4.apache.org/43719] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 10:10:36,380 INFO [Listener at jenkins-hbase4.apache.org/43719] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 10:10:36,473 INFO [Listener at jenkins-hbase4.apache.org/43719] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 10:10:36,513 INFO [Listener at jenkins-hbase4.apache.org/43719] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:46001 2023-07-18 10:10:36,862 WARN [Listener at jenkins-hbase4.apache.org/42677] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-18 10:10:36,870 WARN [Listener at jenkins-hbase4.apache.org/42677] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-18 10:10:36,871 INFO [Listener at jenkins-hbase4.apache.org/42677] log.Slf4jLog(67): jetty-6.1.26 2023-07-18 10:10:36,882 INFO [Listener at jenkins-hbase4.apache.org/42677] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_42517_node____.pufzz9/webapp 2023-07-18 10:10:36,957 INFO [Listener at jenkins-hbase4.apache.org/42677] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-18 10:10:36,958 INFO [Listener at jenkins-hbase4.apache.org/42677] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-18 10:10:36,958 INFO [Listener at jenkins-hbase4.apache.org/42677] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-18 10:10:36,958 INFO [Listener at jenkins-hbase4.apache.org/42677] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-18 10:10:36,968 INFO [Listener at jenkins-hbase4.apache.org/42677] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 10:10:36,994 INFO [Listener at jenkins-hbase4.apache.org/42677] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 10:10:37,080 INFO [Listener at jenkins-hbase4.apache.org/42677] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 10:10:37,091 INFO [Listener at jenkins-hbase4.apache.org/42677] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:42517 2023-07-18 10:10:37,119 INFO [Listener at jenkins-hbase4.apache.org/42677] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-18 10:10:37,121 INFO [Listener at jenkins-hbase4.apache.org/42677] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 10:10:37,190 INFO [Listener at jenkins-hbase4.apache.org/42677] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=708, OpenFileDescriptor=913, MaxFileDescriptor=60000, SystemLoadAverage=321, ProcessCount=177, AvailableMemoryMB=4831 2023-07-18 10:10:37,190 WARN [Listener at jenkins-hbase4.apache.org/42677] hbase.ResourceChecker(130): Thread=708 is superior to 500 2023-07-18 10:10:37,205 DEBUG [Listener at jenkins-hbase4.apache.org/42677] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-18 10:10:37,212 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49072, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-18 10:10:37,219 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-18 10:10:37,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-18 10:10:37,225 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 10:10:37,225 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-18 10:10:37,227 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 10:10:37,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-18 10:10:37,231 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportWithTargetName/e42de0506b88a5586b0ab0cb0a1c249b 2023-07-18 10:10:37,232 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportWithTargetName/c16e98a82417e96766d3125a4b222d0f 2023-07-18 10:10:37,232 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportWithTargetName/e42de0506b88a5586b0ab0cb0a1c249b empty. 2023-07-18 10:10:37,234 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportWithTargetName/c16e98a82417e96766d3125a4b222d0f empty. 2023-07-18 10:10:37,235 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportWithTargetName/e42de0506b88a5586b0ab0cb0a1c249b 2023-07-18 10:10:37,236 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportWithTargetName/c16e98a82417e96766d3125a4b222d0f 2023-07-18 10:10:37,236 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-18 10:10:37,269 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-18 10:10:37,271 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => e42de0506b88a5586b0ab0cb0a1c249b, NAME => 'testtb-testExportWithTargetName,,1689675037218.e42de0506b88a5586b0ab0cb0a1c249b.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp 2023-07-18 10:10:37,271 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => c16e98a82417e96766d3125a4b222d0f, NAME => 'testtb-testExportWithTargetName,1,1689675037218.c16e98a82417e96766d3125a4b222d0f.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp 2023-07-18 10:10:37,305 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689675037218.e42de0506b88a5586b0ab0cb0a1c249b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:10:37,308 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing e42de0506b88a5586b0ab0cb0a1c249b, disabling compactions & flushes 2023-07-18 10:10:37,308 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689675037218.e42de0506b88a5586b0ab0cb0a1c249b. 2023-07-18 10:10:37,308 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689675037218.e42de0506b88a5586b0ab0cb0a1c249b. 2023-07-18 10:10:37,308 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689675037218.e42de0506b88a5586b0ab0cb0a1c249b. after waiting 0 ms 2023-07-18 10:10:37,309 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689675037218.e42de0506b88a5586b0ab0cb0a1c249b. 2023-07-18 10:10:37,309 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689675037218.e42de0506b88a5586b0ab0cb0a1c249b. 2023-07-18 10:10:37,309 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for e42de0506b88a5586b0ab0cb0a1c249b: 2023-07-18 10:10:37,310 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689675037218.c16e98a82417e96766d3125a4b222d0f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:10:37,311 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing c16e98a82417e96766d3125a4b222d0f, disabling compactions & flushes 2023-07-18 10:10:37,311 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689675037218.c16e98a82417e96766d3125a4b222d0f. 2023-07-18 10:10:37,311 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689675037218.c16e98a82417e96766d3125a4b222d0f. 2023-07-18 10:10:37,311 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689675037218.c16e98a82417e96766d3125a4b222d0f. after waiting 0 ms 2023-07-18 10:10:37,311 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689675037218.c16e98a82417e96766d3125a4b222d0f. 2023-07-18 10:10:37,311 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689675037218.c16e98a82417e96766d3125a4b222d0f. 2023-07-18 10:10:37,311 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for c16e98a82417e96766d3125a4b222d0f: 2023-07-18 10:10:37,320 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 10:10:37,321 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689675037218.e42de0506b88a5586b0ab0cb0a1c249b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689675037321"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689675037321"}]},"ts":"1689675037321"} 2023-07-18 10:10:37,321 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689675037218.c16e98a82417e96766d3125a4b222d0f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689675037321"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689675037321"}]},"ts":"1689675037321"} 2023-07-18 10:10:37,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-18 10:10:37,376 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-18 10:10:37,378 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 10:10:37,378 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689675037378"}]},"ts":"1689675037378"} 2023-07-18 10:10:37,380 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-18 10:10:37,386 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 10:10:37,388 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 10:10:37,388 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 10:10:37,388 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 10:10:37,388 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 10:10:37,388 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e42de0506b88a5586b0ab0cb0a1c249b, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=c16e98a82417e96766d3125a4b222d0f, ASSIGN}] 2023-07-18 10:10:37,395 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=c16e98a82417e96766d3125a4b222d0f, ASSIGN 2023-07-18 10:10:37,395 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e42de0506b88a5586b0ab0cb0a1c249b, ASSIGN 2023-07-18 10:10:37,396 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=c16e98a82417e96766d3125a4b222d0f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34221,1689675027589; forceNewPlan=false, retain=false 2023-07-18 10:10:37,396 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e42de0506b88a5586b0ab0cb0a1c249b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33757,1689675027667; forceNewPlan=false, retain=false 2023-07-18 10:10:37,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-18 10:10:37,546 INFO [jenkins-hbase4:46557] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-18 10:10:37,549 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=e42de0506b88a5586b0ab0cb0a1c249b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:37,549 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=c16e98a82417e96766d3125a4b222d0f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:37,550 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689675037218.e42de0506b88a5586b0ab0cb0a1c249b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689675037549"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689675037549"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689675037549"}]},"ts":"1689675037549"} 2023-07-18 10:10:37,550 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689675037218.c16e98a82417e96766d3125a4b222d0f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689675037549"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689675037549"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689675037549"}]},"ts":"1689675037549"} 2023-07-18 10:10:37,553 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure e42de0506b88a5586b0ab0cb0a1c249b, server=jenkins-hbase4.apache.org,33757,1689675027667}] 2023-07-18 10:10:37,555 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure c16e98a82417e96766d3125a4b222d0f, server=jenkins-hbase4.apache.org,34221,1689675027589}] 2023-07-18 10:10:37,708 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:37,709 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-18 10:10:37,710 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47652, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-18 10:10:37,715 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689675037218.c16e98a82417e96766d3125a4b222d0f. 2023-07-18 10:10:37,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c16e98a82417e96766d3125a4b222d0f, NAME => 'testtb-testExportWithTargetName,1,1689675037218.c16e98a82417e96766d3125a4b222d0f.', STARTKEY => '1', ENDKEY => ''} 2023-07-18 10:10:37,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689675037218.c16e98a82417e96766d3125a4b222d0f. service=AccessControlService 2023-07-18 10:10:37,716 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 10:10:37,716 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689675037218.e42de0506b88a5586b0ab0cb0a1c249b. 2023-07-18 10:10:37,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName c16e98a82417e96766d3125a4b222d0f 2023-07-18 10:10:37,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e42de0506b88a5586b0ab0cb0a1c249b, NAME => 'testtb-testExportWithTargetName,,1689675037218.e42de0506b88a5586b0ab0cb0a1c249b.', STARTKEY => '', ENDKEY => '1'} 2023-07-18 10:10:37,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689675037218.c16e98a82417e96766d3125a4b222d0f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:10:37,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c16e98a82417e96766d3125a4b222d0f 2023-07-18 10:10:37,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c16e98a82417e96766d3125a4b222d0f 2023-07-18 10:10:37,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689675037218.e42de0506b88a5586b0ab0cb0a1c249b. service=AccessControlService 2023-07-18 10:10:37,717 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 10:10:37,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName e42de0506b88a5586b0ab0cb0a1c249b 2023-07-18 10:10:37,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689675037218.e42de0506b88a5586b0ab0cb0a1c249b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:10:37,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e42de0506b88a5586b0ab0cb0a1c249b 2023-07-18 10:10:37,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e42de0506b88a5586b0ab0cb0a1c249b 2023-07-18 10:10:37,719 INFO [StoreOpener-c16e98a82417e96766d3125a4b222d0f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c16e98a82417e96766d3125a4b222d0f 2023-07-18 10:10:37,719 INFO [StoreOpener-e42de0506b88a5586b0ab0cb0a1c249b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e42de0506b88a5586b0ab0cb0a1c249b 2023-07-18 10:10:37,722 DEBUG [StoreOpener-c16e98a82417e96766d3125a4b222d0f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportWithTargetName/c16e98a82417e96766d3125a4b222d0f/cf 2023-07-18 10:10:37,722 DEBUG [StoreOpener-c16e98a82417e96766d3125a4b222d0f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportWithTargetName/c16e98a82417e96766d3125a4b222d0f/cf 2023-07-18 10:10:37,722 DEBUG [StoreOpener-e42de0506b88a5586b0ab0cb0a1c249b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportWithTargetName/e42de0506b88a5586b0ab0cb0a1c249b/cf 2023-07-18 10:10:37,722 DEBUG [StoreOpener-e42de0506b88a5586b0ab0cb0a1c249b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportWithTargetName/e42de0506b88a5586b0ab0cb0a1c249b/cf 2023-07-18 10:10:37,723 INFO [StoreOpener-c16e98a82417e96766d3125a4b222d0f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c16e98a82417e96766d3125a4b222d0f columnFamilyName cf 2023-07-18 10:10:37,723 INFO [StoreOpener-e42de0506b88a5586b0ab0cb0a1c249b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e42de0506b88a5586b0ab0cb0a1c249b columnFamilyName cf 2023-07-18 10:10:37,724 INFO [StoreOpener-e42de0506b88a5586b0ab0cb0a1c249b-1] regionserver.HStore(310): Store=e42de0506b88a5586b0ab0cb0a1c249b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 10:10:37,724 INFO [StoreOpener-c16e98a82417e96766d3125a4b222d0f-1] regionserver.HStore(310): Store=c16e98a82417e96766d3125a4b222d0f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 10:10:37,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportWithTargetName/e42de0506b88a5586b0ab0cb0a1c249b 2023-07-18 10:10:37,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportWithTargetName/c16e98a82417e96766d3125a4b222d0f 2023-07-18 10:10:37,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportWithTargetName/c16e98a82417e96766d3125a4b222d0f 2023-07-18 10:10:37,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportWithTargetName/e42de0506b88a5586b0ab0cb0a1c249b 2023-07-18 10:10:37,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c16e98a82417e96766d3125a4b222d0f 2023-07-18 10:10:37,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e42de0506b88a5586b0ab0cb0a1c249b 2023-07-18 10:10:37,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportWithTargetName/c16e98a82417e96766d3125a4b222d0f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 10:10:37,768 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c16e98a82417e96766d3125a4b222d0f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72974913, jitterRate=0.08741094172000885}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 10:10:37,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c16e98a82417e96766d3125a4b222d0f: 2023-07-18 10:10:37,776 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689675037218.c16e98a82417e96766d3125a4b222d0f., pid=16, masterSystemTime=1689675037709 2023-07-18 10:10:37,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportWithTargetName/e42de0506b88a5586b0ab0cb0a1c249b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 10:10:37,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689675037218.c16e98a82417e96766d3125a4b222d0f. 2023-07-18 10:10:37,779 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689675037218.c16e98a82417e96766d3125a4b222d0f. 2023-07-18 10:10:37,780 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e42de0506b88a5586b0ab0cb0a1c249b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59949231, jitterRate=-0.10668684542179108}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 10:10:37,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e42de0506b88a5586b0ab0cb0a1c249b: 2023-07-18 10:10:37,781 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=c16e98a82417e96766d3125a4b222d0f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:37,781 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689675037218.c16e98a82417e96766d3125a4b222d0f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689675037781"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689675037781"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689675037781"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689675037781"}]},"ts":"1689675037781"} 2023-07-18 10:10:37,786 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689675037218.e42de0506b88a5586b0ab0cb0a1c249b., pid=15, masterSystemTime=1689675037708 2023-07-18 10:10:37,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689675037218.e42de0506b88a5586b0ab0cb0a1c249b. 2023-07-18 10:10:37,794 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689675037218.e42de0506b88a5586b0ab0cb0a1c249b. 2023-07-18 10:10:37,795 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=14 2023-07-18 10:10:37,796 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=e42de0506b88a5586b0ab0cb0a1c249b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:37,796 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure c16e98a82417e96766d3125a4b222d0f, server=jenkins-hbase4.apache.org,34221,1689675027589 in 231 msec 2023-07-18 10:10:37,796 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689675037218.e42de0506b88a5586b0ab0cb0a1c249b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689675037795"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689675037795"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689675037795"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689675037795"}]},"ts":"1689675037795"} 2023-07-18 10:10:37,799 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=c16e98a82417e96766d3125a4b222d0f, ASSIGN in 407 msec 2023-07-18 10:10:37,802 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=13 2023-07-18 10:10:37,803 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure e42de0506b88a5586b0ab0cb0a1c249b, server=jenkins-hbase4.apache.org,33757,1689675027667 in 246 msec 2023-07-18 10:10:37,806 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-18 10:10:37,806 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e42de0506b88a5586b0ab0cb0a1c249b, ASSIGN in 415 msec 2023-07-18 10:10:37,807 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 10:10:37,807 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689675037807"}]},"ts":"1689675037807"} 2023-07-18 10:10:37,809 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-18 10:10:37,813 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 10:10:37,818 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-18 10:10:37,827 DEBUG [hconnection-0x101bcded-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:10:37,830 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59760, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=ClientService 2023-07-18 10:10:37,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-18 10:10:37,839 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34221] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-18 10:10:37,871 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-18 10:10:37,871 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-18 10:10:37,871 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-18 10:10:37,871 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-18 10:10:37,872 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 10:10:37,887 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-18 10:10:37,887 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-18 10:10:37,887 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-18 10:10:37,887 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-18 10:10:37,889 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-18 10:10:37,891 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-18 10:10:37,892 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 669 msec 2023-07-18 10:10:38,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-18 10:10:38,336 INFO [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-18 10:10:38,336 DEBUG [Listener at jenkins-hbase4.apache.org/42677] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportWithTargetName get assigned. Timeout = 60000ms 2023-07-18 10:10:38,337 INFO [Listener at jenkins-hbase4.apache.org/42677] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 10:10:38,342 INFO [Listener at jenkins-hbase4.apache.org/42677] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportWithTargetName assigned to meta. Checking AM states. 2023-07-18 10:10:38,343 INFO [Listener at jenkins-hbase4.apache.org/42677] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 10:10:38,343 INFO [Listener at jenkins-hbase4.apache.org/42677] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportWithTargetName assigned. 2023-07-18 10:10:38,358 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-18 10:10:38,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689675038358 (current time:1689675038358). 2023-07-18 10:10:38,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 10:10:38,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] zookeeper.ReadOnlyZKClient(139): Connect 0x4c3feea0 to 127.0.0.1:56089 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 10:10:38,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1b4af3a5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 10:10:38,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:10:38,377 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59762, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:10:38,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4c3feea0 to 127.0.0.1:56089 2023-07-18 10:10:38,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 10:10:38,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] zookeeper.ReadOnlyZKClient(139): Connect 0x4ecb5dec to 127.0.0.1:56089 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 10:10:38,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@51de70d5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 10:10:38,396 DEBUG [hconnection-0x5a5ec4c4-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:10:38,398 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59768, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:10:38,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:10:38,410 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48304, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:10:38,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4ecb5dec to 127.0.0.1:56089 2023-07-18 10:10:38,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 10:10:38,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-18 10:10:38,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 10:10:38,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-18 10:10:38,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-18 10:10:38,473 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-18 10:10:38,474 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689675638474 2023-07-18 10:10:38,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-18 10:10:38,475 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-18 10:10:38,478 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-18 10:10:38,482 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 10:10:38,482 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 10:10:38,486 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-18 10:10:38,487 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 19 msec 2023-07-18 10:10:38,488 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-18 10:10:38,491 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689675638491 2023-07-18 10:10:38,547 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,547 INFO [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-18 10:10:38,547 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:10:38,548 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-18 10:10:38,548 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-18 10:10:38,549 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,549 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,555 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:10:38,555 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:10:38,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:10:38,555 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:38,555 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:10:38,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:10:38,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:10:38,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:10:38,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:10:38,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:10:38,556 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:38,556 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:38,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,557 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:38,557 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 10:10:38,557 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,557 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,557 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-18 10:10:38,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-18 10:10:38,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,558 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-18 10:10:38,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-18 10:10:38,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,559 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-18 10:10:38,558 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-18 10:10:38,561 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,561 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,561 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,561 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-18 10:10:38,561 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-18 10:10:38,562 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:10:38,561 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:10:38,563 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-18 10:10:38,564 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-18 10:10:38,563 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-18 10:10:38,564 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-18 10:10:38,564 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:10:38,564 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33757,1689675027667' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-18 10:10:38,565 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-18 10:10:38,565 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-18 10:10:38,564 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-18 10:10:38,565 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34221,1689675027589' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-18 10:10:38,565 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40089,1689675027524' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-18 10:10:38,568 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:38,568 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:38,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:10:38,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:10:38,569 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,569 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,569 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:10:38,569 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:38,569 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:10:38,569 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,569 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:10:38,569 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:10:38,570 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:10:38,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:38,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:38,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:38,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:10:38,572 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33757,1689675027667' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-18 10:10:38,572 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@35632732[Count = 1] remaining members to acquire global barrier 2023-07-18 10:10:38,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:38,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:10:38,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:10:38,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:10:38,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:10:38,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:38,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:38,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:38,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:10:38,577 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34221,1689675027589' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-18 10:10:38,577 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@35632732[Count = 0] remaining members to acquire global barrier 2023-07-18 10:10:38,577 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-18 10:10:38,577 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,580 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,580 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,581 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,581 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-18 10:10:38,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,581 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-18 10:10:38,581 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-18 10:10:38,581 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,40089,1689675027524' in zk 2023-07-18 10:10:38,582 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,582 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-18 10:10:38,582 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 10:10:38,582 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:38,586 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 10:10:38,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-18 10:10:38,586 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689675037218.e42de0506b88a5586b0ab0cb0a1c249b. 2023-07-18 10:10:38,586 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 10:10:38,588 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-18 10:10:38,588 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:38,588 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:10:38,588 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 10:10:38,588 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-18 10:10:38,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-18 10:10:38,590 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 10:10:38,591 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689675037218.e42de0506b88a5586b0ab0cb0a1c249b. started... 2023-07-18 10:10:38,594 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 10:10:38,599 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 10:10:38,600 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689675037218.c16e98a82417e96766d3125a4b222d0f. 2023-07-18 10:10:38,600 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689675037218.c16e98a82417e96766d3125a4b222d0f. started... 2023-07-18 10:10:38,602 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e42de0506b88a5586b0ab0cb0a1c249b: 2023-07-18 10:10:38,602 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c16e98a82417e96766d3125a4b222d0f: 2023-07-18 10:10:38,603 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689675037218.e42de0506b88a5586b0ab0cb0a1c249b.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,603 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689675037218.c16e98a82417e96766d3125a4b222d0f.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,611 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 10:10:38,612 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 10:10:38,615 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 10:10:38,615 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 10:10:38,716 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689675037218.c16e98a82417e96766d3125a4b222d0f. completed. 2023-07-18 10:10:38,717 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689675037218.c16e98a82417e96766d3125a4b222d0f. 2023-07-18 10:10:38,717 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 10:10:38,717 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 10:10:38,717 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:38,717 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-18 10:10:38,718 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,34221,1689675027589' in zk 2023-07-18 10:10:38,719 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689675037218.e42de0506b88a5586b0ab0cb0a1c249b. completed. 2023-07-18 10:10:38,719 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689675037218.e42de0506b88a5586b0ab0cb0a1c249b. 2023-07-18 10:10:38,719 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 10:10:38,719 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 10:10:38,719 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:38,719 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-18 10:10:38,720 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,33757,1689675027667' in zk 2023-07-18 10:10:38,720 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-18 10:10:38,720 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:38,720 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:10:38,720 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-18 10:10:38,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:38,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:10:38,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:10:38,722 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-18 10:10:38,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:10:38,722 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:38,722 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:10:38,723 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-18 10:10:38,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:10:38,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:38,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:38,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:38,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:10:38,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:38,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:38,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:38,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,34221,1689675027589': 2023-07-18 10:10:38,729 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34221,1689675027589' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-18 10:10:38,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:38,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:10:38,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:10:38,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:10:38,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:10:38,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:38,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:38,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:38,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:10:38,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:38,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:38,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:38,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,33757,1689675027667': 2023-07-18 10:10:38,738 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33757,1689675027667' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-18 10:10:38,738 INFO [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-18 10:10:38,738 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 10:10:38,738 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 10:10:38,738 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,738 INFO [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 10:10:38,742 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,742 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,742 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,742 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,742 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:10:38,742 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,742 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,742 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,742 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:10:38,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:10:38,742 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:10:38,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:10:38,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:10:38,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:10:38,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:10:38,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:10:38,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:10:38,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:10:38,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:10:38,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,744 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:38,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,745 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:38,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:10:38,745 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:38,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:38,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:38,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:38,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:10:38,749 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:38,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,749 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:38,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:38,749 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:38,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:38,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:38,765 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:38,765 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,765 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:38,765 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:10:38,765 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:10:38,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:10:38,765 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:10:38,765 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:10:38,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:10:38,766 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:38,766 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:10:38,766 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:10:38,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:10:38,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:10:38,765 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:10:38,766 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,766 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:10:38,766 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:38,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:10:38,767 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,767 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,767 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:10:38,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:10:38,767 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:38,767 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:10:38,768 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:38,768 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:10:38,768 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:10:38,768 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:10:38,770 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,790 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 10:10:38,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-18 10:10:38,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-18 10:10:38,800 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-18 10:10:38,829 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:39,100 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 10:10:39,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-18 10:10:39,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-18 10:10:39,103 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-18 10:10:39,296 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-18 10:10:39,297 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:39,297 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:39,298 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689675038475Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689675038766 (+291 ms)Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689675038767 (+1 ms)Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689675038782 (+15 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689675038811 (+29 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689675039296 (+485 ms) 2023-07-18 10:10:39,300 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-18 10:10:39,303 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 821 msec 2023-07-18 10:10:39,603 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 10:10:39,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-18 10:10:39,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 10:10:39,627 DEBUG [htable-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:10:39,628 DEBUG [htable-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:10:39,635 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47662, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:10:39,635 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48312, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:10:39,636 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33757] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689675037218.e42de0506b88a5586b0ab0cb0a1c249b. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 10:10:39,637 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34221] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689675037218.c16e98a82417e96766d3125a4b222d0f. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 10:10:39,642 DEBUG [Listener at jenkins-hbase4.apache.org/42677] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-18 10:10:39,643 DEBUG [Listener at jenkins-hbase4.apache.org/42677] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689675037218.e42de0506b88a5586b0ab0cb0a1c249b. 2023-07-18 10:10:39,645 INFO [Listener at jenkins-hbase4.apache.org/42677] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 10:10:39,671 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-18 10:10:39,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689675039671 (current time:1689675039671). 2023-07-18 10:10:39,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 10:10:39,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] zookeeper.ReadOnlyZKClient(139): Connect 0x427702e7 to 127.0.0.1:56089 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 10:10:39,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@18eb6c5a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 10:10:39,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:10:39,681 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59784, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:10:39,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x427702e7 to 127.0.0.1:56089 2023-07-18 10:10:39,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 10:10:39,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] zookeeper.ReadOnlyZKClient(139): Connect 0x7294d8d2 to 127.0.0.1:56089 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 10:10:39,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@80e8c5d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 10:10:39,692 DEBUG [hconnection-0x4bc4a8ba-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:10:39,695 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59786, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:10:39,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:10:39,701 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48328, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:10:39,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7294d8d2 to 127.0.0.1:56089 2023-07-18 10:10:39,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 10:10:39,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-18 10:10:39,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 10:10:39,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-18 10:10:39,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-18 10:10:39,708 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-18 10:10:39,709 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689675639709 2023-07-18 10:10:39,709 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-18 10:10:39,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-18 10:10:39,710 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 10:10:39,710 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 10:10:39,711 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-18 10:10:39,711 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-18 10:10:39,713 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 5 msec 2023-07-18 10:10:39,714 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-18 10:10:39,714 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689675639714 2023-07-18 10:10:39,730 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-18 10:10:39,730 INFO [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-18 10:10:39,730 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:10:39,731 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-18 10:10:39,731 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-18 10:10:39,732 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,732 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,733 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:10:39,733 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:10:39,733 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:39,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:10:39,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:10:39,733 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:10:39,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:10:39,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:10:39,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:10:39,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:10:39,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,734 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:39,735 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:39,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,735 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,736 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,736 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,736 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:39,736 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 10:10:39,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-18 10:10:39,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-18 10:10:39,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-18 10:10:39,736 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-18 10:10:39,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,737 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-18 10:10:39,737 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-18 10:10:39,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,737 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-18 10:10:39,737 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-18 10:10:39,737 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:10:39,737 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-18 10:10:39,737 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-18 10:10:39,737 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:10:39,738 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-18 10:10:39,739 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-18 10:10:39,740 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-18 10:10:39,740 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:10:39,739 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-18 10:10:39,741 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-18 10:10:39,741 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-18 10:10:39,740 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-18 10:10:39,741 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34221,1689675027589' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-18 10:10:39,741 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-18 10:10:39,741 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40089,1689675027524' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-18 10:10:39,742 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33757,1689675027667' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-18 10:10:39,745 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,745 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:39,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:39,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:10:39,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:10:39,745 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,746 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,746 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:39,746 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:10:39,746 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:10:39,746 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,746 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:10:39,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:10:39,746 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,747 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:10:39,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-18 10:10:39,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:39,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:39,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:39,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:10:39,748 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34221,1689675027589' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-18 10:10:39,748 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1d6f1e3e[Count = 1] remaining members to acquire global barrier 2023-07-18 10:10:39,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:39,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:10:39,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:10:39,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:10:39,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:10:39,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-18 10:10:39,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:39,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:39,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:39,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:10:39,751 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33757,1689675027667' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-18 10:10:39,751 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1d6f1e3e[Count = 0] remaining members to acquire global barrier 2023-07-18 10:10:39,751 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-18 10:10:39,751 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,757 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,757 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,757 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,757 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,757 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,757 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:39,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,757 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-18 10:10:39,757 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-18 10:10:39,757 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,757 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-18 10:10:39,757 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 10:10:39,758 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 10:10:39,757 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-18 10:10:39,757 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:39,758 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689675037218.e42de0506b88a5586b0ab0cb0a1c249b. 2023-07-18 10:10:39,758 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 10:10:39,758 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689675037218.c16e98a82417e96766d3125a4b222d0f. 2023-07-18 10:10:39,758 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,40089,1689675027524' in zk 2023-07-18 10:10:39,758 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 10:10:39,758 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 10:10:39,758 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689675037218.c16e98a82417e96766d3125a4b222d0f. started... 2023-07-18 10:10:39,758 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689675037218.e42de0506b88a5586b0ab0cb0a1c249b. started... 2023-07-18 10:10:39,758 INFO [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e42de0506b88a5586b0ab0cb0a1c249b 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-07-18 10:10:39,759 INFO [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c16e98a82417e96766d3125a4b222d0f 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-07-18 10:10:39,761 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-18 10:10:39,761 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:10:39,761 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-18 10:10:39,810 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 10:10:39,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-18 10:10:39,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-18 10:10:39,812 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 10:10:39,862 INFO [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.87 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportWithTargetName/c16e98a82417e96766d3125a4b222d0f/.tmp/cf/28923229f2354e5f8bf60673ca4a1ebc 2023-07-18 10:10:39,869 INFO [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=400 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportWithTargetName/e42de0506b88a5586b0ab0cb0a1c249b/.tmp/cf/a101c029eb924802b40cfb80382e6021 2023-07-18 10:10:39,921 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportWithTargetName/e42de0506b88a5586b0ab0cb0a1c249b/.tmp/cf/a101c029eb924802b40cfb80382e6021 as hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportWithTargetName/e42de0506b88a5586b0ab0cb0a1c249b/cf/a101c029eb924802b40cfb80382e6021 2023-07-18 10:10:39,921 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportWithTargetName/c16e98a82417e96766d3125a4b222d0f/.tmp/cf/28923229f2354e5f8bf60673ca4a1ebc as hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportWithTargetName/c16e98a82417e96766d3125a4b222d0f/cf/28923229f2354e5f8bf60673ca4a1ebc 2023-07-18 10:10:39,935 INFO [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportWithTargetName/e42de0506b88a5586b0ab0cb0a1c249b/cf/a101c029eb924802b40cfb80382e6021, entries=6, sequenceid=6, filesize=5.2 K 2023-07-18 10:10:39,945 INFO [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for e42de0506b88a5586b0ab0cb0a1c249b in 187ms, sequenceid=6, compaction requested=false 2023-07-18 10:10:39,945 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-18 10:10:39,946 INFO [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportWithTargetName/c16e98a82417e96766d3125a4b222d0f/cf/28923229f2354e5f8bf60673ca4a1ebc, entries=44, sequenceid=6, filesize=7.8 K 2023-07-18 10:10:39,949 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e42de0506b88a5586b0ab0cb0a1c249b: 2023-07-18 10:10:39,951 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689675037218.e42de0506b88a5586b0ab0cb0a1c249b.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-18 10:10:39,951 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 10:10:39,951 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportWithTargetName/e42de0506b88a5586b0ab0cb0a1c249b/cf/a101c029eb924802b40cfb80382e6021] hfiles 2023-07-18 10:10:39,951 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportWithTargetName/e42de0506b88a5586b0ab0cb0a1c249b/cf/a101c029eb924802b40cfb80382e6021 for snapshot=snaptb0-testExportWithTargetName 2023-07-18 10:10:39,979 INFO [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for c16e98a82417e96766d3125a4b222d0f in 221ms, sequenceid=6, compaction requested=false 2023-07-18 10:10:39,981 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c16e98a82417e96766d3125a4b222d0f: 2023-07-18 10:10:39,981 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689675037218.c16e98a82417e96766d3125a4b222d0f.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-18 10:10:39,981 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 10:10:39,981 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportWithTargetName/c16e98a82417e96766d3125a4b222d0f/cf/28923229f2354e5f8bf60673ca4a1ebc] hfiles 2023-07-18 10:10:39,981 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportWithTargetName/c16e98a82417e96766d3125a4b222d0f/cf/28923229f2354e5f8bf60673ca4a1ebc for snapshot=snaptb0-testExportWithTargetName 2023-07-18 10:10:40,013 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 10:10:40,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-18 10:10:40,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-18 10:10:40,019 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-18 10:10:40,020 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689675037218.e42de0506b88a5586b0ab0cb0a1c249b. completed. 2023-07-18 10:10:40,020 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689675037218.e42de0506b88a5586b0ab0cb0a1c249b. 2023-07-18 10:10:40,021 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 10:10:40,021 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 10:10:40,021 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:40,021 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-18 10:10:40,021 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,33757,1689675027667' in zk 2023-07-18 10:10:40,021 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689675037218.c16e98a82417e96766d3125a4b222d0f. completed. 2023-07-18 10:10:40,021 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689675037218.c16e98a82417e96766d3125a4b222d0f. 2023-07-18 10:10:40,021 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 10:10:40,022 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 10:10:40,022 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:40,022 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-18 10:10:40,022 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,34221,1689675027589' in zk 2023-07-18 10:10:40,023 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:40,023 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-18 10:10:40,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:40,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:10:40,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:10:40,023 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:10:40,023 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-18 10:10:40,028 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:40,028 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-18 10:10:40,028 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:10:40,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:10:40,028 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-18 10:10:40,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:10:40,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-18 10:10:40,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:40,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:40,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:40,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:10:40,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-18 10:10:40,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:40,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:40,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:40,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,33757,1689675027667': 2023-07-18 10:10:40,035 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33757,1689675027667' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-18 10:10:40,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:40,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:10:40,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:10:40,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:10:40,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:10:40,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-18 10:10:40,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:40,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:40,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:40,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:10:40,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-18 10:10:40,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:40,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:40,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:40,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,34221,1689675027589': 2023-07-18 10:10:40,044 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34221,1689675027589' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-18 10:10:40,044 INFO [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-18 10:10:40,044 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 10:10:40,044 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 10:10:40,044 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-18 10:10:40,044 INFO [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 10:10:40,048 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 10:10:40,048 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 10:10:40,048 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 10:10:40,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 10:10:40,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 10:10:40,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 10:10:40,048 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:10:40,048 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:10:40,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 10:10:40,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:10:40,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:10:40,048 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 10:10:40,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:10:40,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 10:10:40,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:10:40,049 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:10:40,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 10:10:40,049 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:40,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:10:40,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 10:10:40,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 10:10:40,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:10:40,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:10:40,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:10:40,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:10:40,050 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:40,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-18 10:10:40,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 10:10:40,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 10:10:40,051 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:40,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:10:40,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-18 10:10:40,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:40,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:40,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:40,054 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:40,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:10:40,054 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:40,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-18 10:10:40,055 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:40,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:40,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:40,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:40,069 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:10:40,069 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:10:40,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:10:40,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:10:40,069 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:10:40,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:10:40,070 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:40,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:10:40,069 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:10:40,070 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:10:40,070 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-18 10:10:40,070 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:10:40,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:10:40,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:10:40,070 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:10:40,070 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:40,070 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-18 10:10:40,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:10:40,071 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-18 10:10:40,071 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:40,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:10:40,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:10:40,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:10:40,071 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-18 10:10:40,072 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:40,072 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 10:10:40,072 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:40,072 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:40,072 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 10:10:40,072 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 10:10:40,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:10:40,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:10:40,073 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-18 10:10:40,110 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-18 10:10:40,170 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-18 10:10:40,170 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-18 10:10:40,171 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-18 10:10:40,171 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689675039709Consolidate snapshot: snaptb0-testExportWithTargetName at 1689675040071 (+362 ms)Loading Region manifests for snaptb0-testExportWithTargetName at 1689675040071Writing data manifest for snaptb0-testExportWithTargetName at 1689675040077 (+6 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689675040094 (+17 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689675040170 (+76 ms) 2023-07-18 10:10:40,173 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-18 10:10:40,177 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 464 msec 2023-07-18 10:10:40,319 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 10:10:40,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-18 10:10:40,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 10:10:40,323 INFO [Listener at jenkins-hbase4.apache.org/42677] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/export-test/export-1689675040323 2023-07-18 10:10:40,323 INFO [Listener at jenkins-hbase4.apache.org/42677] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35953, tgtDir=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/export-test/export-1689675040323, rawTgtDir=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/export-test/export-1689675040323, srcFsUri=hdfs://localhost:35953, srcDir=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336 2023-07-18 10:10:40,368 DEBUG [Listener at jenkins-hbase4.apache.org/42677] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35953, inputRoot=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336 2023-07-18 10:10:40,368 DEBUG [Listener at jenkins-hbase4.apache.org/42677] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-735988609_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/export-test/export-1689675040323, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/export-test/export-1689675040323/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-18 10:10:40,368 INFO [Listener at jenkins-hbase4.apache.org/42677] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35953, inputRoot=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336, snapshotDir=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-18 10:10:40,386 INFO [Listener at jenkins-hbase4.apache.org/42677] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/export-test/export-1689675040323/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-18 10:10:40,462 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-18 10:10:40,463 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-18 10:10:40,464 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-18 10:10:40,465 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-18 10:10:40,465 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-18 10:10:40,466 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-18 10:10:40,466 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-18 10:10:40,560 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/hadoop-6267192731491550530.jar 2023-07-18 10:10:40,561 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-18 10:10:40,561 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-18 10:10:40,562 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-18 10:10:40,562 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-18 10:10:40,563 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-18 10:10:40,563 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-18 10:10:40,564 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-18 10:10:40,564 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-18 10:10:40,565 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-18 10:10:40,566 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-18 10:10:40,566 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-18 10:10:40,567 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-18 10:10:40,567 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-18 10:10:40,567 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-18 10:10:40,568 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-18 10:10:40,568 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-18 10:10:40,571 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 10:10:40,572 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 10:10:40,572 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 10:10:40,573 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 10:10:40,573 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 10:10:40,574 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 10:10:40,575 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 10:10:42,067 WARN [Listener at jenkins-hbase4.apache.org/42677] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-18 10:10:42,076 INFO [Listener at jenkins-hbase4.apache.org/42677] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-18 10:10:42,088 DEBUG [Listener at jenkins-hbase4.apache.org/42677] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-18 10:10:42,701 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 10:10:42,703 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 10:10:43,227 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-18 10:10:43,355 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689675035639_0001_000001 (auth:SIMPLE) 2023-07-18 10:10:48,348 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689675035639_0001_000001 (auth:SIMPLE) 2023-07-18 10:10:50,621 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689675035639_0001_000001 (auth:SIMPLE) 2023-07-18 10:10:54,228 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689675035639_0001_000001 (auth:SIMPLE) 2023-07-18 10:10:56,096 INFO [Listener at jenkins-hbase4.apache.org/42677] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-18 10:10:56,099 INFO [Listener at jenkins-hbase4.apache.org/42677] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-18 10:10:56,112 INFO [Listener at jenkins-hbase4.apache.org/42677] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-18 10:10:56,112 INFO [Listener at jenkins-hbase4.apache.org/42677] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-18 10:10:56,113 INFO [Listener at jenkins-hbase4.apache.org/42677] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-18 10:10:56,113 DEBUG [Listener at jenkins-hbase4.apache.org/42677] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1314676217_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-18 10:10:56,114 DEBUG [Listener at jenkins-hbase4.apache.org/42677] snapshot.TestExportSnapshot(367): hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-18 10:10:56,114 DEBUG [Listener at jenkins-hbase4.apache.org/42677] snapshot.TestExportSnapshot(367): hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-18 10:10:56,114 DEBUG [Listener at jenkins-hbase4.apache.org/42677] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1314676217_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/export-test/export-1689675040323/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/export-test/export-1689675040323/.hbase-snapshot/testExportWithTargetName 2023-07-18 10:10:56,115 DEBUG [Listener at jenkins-hbase4.apache.org/42677] snapshot.TestExportSnapshot(367): hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/export-test/export-1689675040323/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-18 10:10:56,115 DEBUG [Listener at jenkins-hbase4.apache.org/42677] snapshot.TestExportSnapshot(367): hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/export-test/export-1689675040323/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-18 10:10:56,126 INFO [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-18 10:10:56,131 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-18 10:10:56,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-18 10:10:56,150 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689675056150"}]},"ts":"1689675056150"} 2023-07-18 10:10:56,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-18 10:10:56,152 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-18 10:10:56,225 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-18 10:10:56,228 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e42de0506b88a5586b0ab0cb0a1c249b, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=c16e98a82417e96766d3125a4b222d0f, UNASSIGN}] 2023-07-18 10:10:56,231 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e42de0506b88a5586b0ab0cb0a1c249b, UNASSIGN 2023-07-18 10:10:56,231 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=c16e98a82417e96766d3125a4b222d0f, UNASSIGN 2023-07-18 10:10:56,232 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=c16e98a82417e96766d3125a4b222d0f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:56,232 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=e42de0506b88a5586b0ab0cb0a1c249b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:56,232 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689675037218.e42de0506b88a5586b0ab0cb0a1c249b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689675056232"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689675056232"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689675056232"}]},"ts":"1689675056232"} 2023-07-18 10:10:56,232 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689675037218.c16e98a82417e96766d3125a4b222d0f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689675056232"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689675056232"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689675056232"}]},"ts":"1689675056232"} 2023-07-18 10:10:56,235 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure e42de0506b88a5586b0ab0cb0a1c249b, server=jenkins-hbase4.apache.org,33757,1689675027667}] 2023-07-18 10:10:56,235 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure c16e98a82417e96766d3125a4b222d0f, server=jenkins-hbase4.apache.org,34221,1689675027589}] 2023-07-18 10:10:56,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-18 10:10:56,396 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e42de0506b88a5586b0ab0cb0a1c249b 2023-07-18 10:10:56,396 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c16e98a82417e96766d3125a4b222d0f 2023-07-18 10:10:56,396 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e42de0506b88a5586b0ab0cb0a1c249b, disabling compactions & flushes 2023-07-18 10:10:56,396 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c16e98a82417e96766d3125a4b222d0f, disabling compactions & flushes 2023-07-18 10:10:56,396 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689675037218.e42de0506b88a5586b0ab0cb0a1c249b. 2023-07-18 10:10:56,396 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689675037218.c16e98a82417e96766d3125a4b222d0f. 2023-07-18 10:10:56,396 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689675037218.e42de0506b88a5586b0ab0cb0a1c249b. 2023-07-18 10:10:56,396 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689675037218.c16e98a82417e96766d3125a4b222d0f. 2023-07-18 10:10:56,397 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689675037218.e42de0506b88a5586b0ab0cb0a1c249b. after waiting 0 ms 2023-07-18 10:10:56,397 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689675037218.c16e98a82417e96766d3125a4b222d0f. after waiting 0 ms 2023-07-18 10:10:56,397 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689675037218.c16e98a82417e96766d3125a4b222d0f. 2023-07-18 10:10:56,397 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689675037218.e42de0506b88a5586b0ab0cb0a1c249b. 2023-07-18 10:10:56,412 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportWithTargetName/c16e98a82417e96766d3125a4b222d0f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 10:10:56,412 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportWithTargetName/e42de0506b88a5586b0ab0cb0a1c249b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 10:10:56,413 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 10:10:56,413 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 10:10:56,414 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689675037218.c16e98a82417e96766d3125a4b222d0f. 2023-07-18 10:10:56,414 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689675037218.e42de0506b88a5586b0ab0cb0a1c249b. 2023-07-18 10:10:56,414 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c16e98a82417e96766d3125a4b222d0f: 2023-07-18 10:10:56,414 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e42de0506b88a5586b0ab0cb0a1c249b: 2023-07-18 10:10:56,416 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e42de0506b88a5586b0ab0cb0a1c249b 2023-07-18 10:10:56,417 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=e42de0506b88a5586b0ab0cb0a1c249b, regionState=CLOSED 2023-07-18 10:10:56,417 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c16e98a82417e96766d3125a4b222d0f 2023-07-18 10:10:56,417 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689675037218.e42de0506b88a5586b0ab0cb0a1c249b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689675056417"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689675056417"}]},"ts":"1689675056417"} 2023-07-18 10:10:56,418 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=c16e98a82417e96766d3125a4b222d0f, regionState=CLOSED 2023-07-18 10:10:56,418 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689675037218.c16e98a82417e96766d3125a4b222d0f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689675056418"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689675056418"}]},"ts":"1689675056418"} 2023-07-18 10:10:56,422 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=22 2023-07-18 10:10:56,422 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure e42de0506b88a5586b0ab0cb0a1c249b, server=jenkins-hbase4.apache.org,33757,1689675027667 in 184 msec 2023-07-18 10:10:56,423 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=23 2023-07-18 10:10:56,423 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure c16e98a82417e96766d3125a4b222d0f, server=jenkins-hbase4.apache.org,34221,1689675027589 in 185 msec 2023-07-18 10:10:56,424 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e42de0506b88a5586b0ab0cb0a1c249b, UNASSIGN in 194 msec 2023-07-18 10:10:56,425 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=21 2023-07-18 10:10:56,425 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=c16e98a82417e96766d3125a4b222d0f, UNASSIGN in 195 msec 2023-07-18 10:10:56,426 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689675056426"}]},"ts":"1689675056426"} 2023-07-18 10:10:56,428 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-18 10:10:56,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-18 10:10:56,487 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-18 10:10:56,490 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 354 msec 2023-07-18 10:10:56,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-18 10:10:56,755 INFO [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-18 10:10:56,761 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-18 10:10:56,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-18 10:10:56,773 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-18 10:10:56,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-18 10:10:56,776 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-18 10:10:56,779 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34221] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-18 10:10:56,789 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportWithTargetName/e42de0506b88a5586b0ab0cb0a1c249b 2023-07-18 10:10:56,789 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportWithTargetName/c16e98a82417e96766d3125a4b222d0f 2023-07-18 10:10:56,795 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportWithTargetName/e42de0506b88a5586b0ab0cb0a1c249b/cf, FileablePath, hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportWithTargetName/e42de0506b88a5586b0ab0cb0a1c249b/recovered.edits] 2023-07-18 10:10:56,795 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportWithTargetName/c16e98a82417e96766d3125a4b222d0f/cf, FileablePath, hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportWithTargetName/c16e98a82417e96766d3125a4b222d0f/recovered.edits] 2023-07-18 10:10:56,806 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportWithTargetName/c16e98a82417e96766d3125a4b222d0f/cf/28923229f2354e5f8bf60673ca4a1ebc to hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/archive/data/default/testtb-testExportWithTargetName/c16e98a82417e96766d3125a4b222d0f/cf/28923229f2354e5f8bf60673ca4a1ebc 2023-07-18 10:10:56,806 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportWithTargetName/e42de0506b88a5586b0ab0cb0a1c249b/cf/a101c029eb924802b40cfb80382e6021 to hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/archive/data/default/testtb-testExportWithTargetName/e42de0506b88a5586b0ab0cb0a1c249b/cf/a101c029eb924802b40cfb80382e6021 2023-07-18 10:10:56,813 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportWithTargetName/e42de0506b88a5586b0ab0cb0a1c249b/recovered.edits/9.seqid to hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/archive/data/default/testtb-testExportWithTargetName/e42de0506b88a5586b0ab0cb0a1c249b/recovered.edits/9.seqid 2023-07-18 10:10:56,813 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportWithTargetName/c16e98a82417e96766d3125a4b222d0f/recovered.edits/9.seqid to hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/archive/data/default/testtb-testExportWithTargetName/c16e98a82417e96766d3125a4b222d0f/recovered.edits/9.seqid 2023-07-18 10:10:56,814 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportWithTargetName/e42de0506b88a5586b0ab0cb0a1c249b 2023-07-18 10:10:56,814 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportWithTargetName/c16e98a82417e96766d3125a4b222d0f 2023-07-18 10:10:56,814 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-18 10:10:56,817 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-18 10:10:56,841 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-18 10:10:56,844 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-18 10:10:56,846 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-18 10:10:56,846 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-18 10:10:56,846 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689675037218.e42de0506b88a5586b0ab0cb0a1c249b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689675056846"}]},"ts":"9223372036854775807"} 2023-07-18 10:10:56,846 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689675037218.c16e98a82417e96766d3125a4b222d0f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689675056846"}]},"ts":"9223372036854775807"} 2023-07-18 10:10:56,849 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-18 10:10:56,849 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => e42de0506b88a5586b0ab0cb0a1c249b, NAME => 'testtb-testExportWithTargetName,,1689675037218.e42de0506b88a5586b0ab0cb0a1c249b.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => c16e98a82417e96766d3125a4b222d0f, NAME => 'testtb-testExportWithTargetName,1,1689675037218.c16e98a82417e96766d3125a4b222d0f.', STARTKEY => '1', ENDKEY => ''}] 2023-07-18 10:10:56,849 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-18 10:10:56,849 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689675056849"}]},"ts":"9223372036854775807"} 2023-07-18 10:10:56,852 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-18 10:10:56,887 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-18 10:10:56,887 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-18 10:10:56,887 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-18 10:10:56,887 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-18 10:10:56,941 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-18 10:10:56,941 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-18 10:10:56,941 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-18 10:10:56,943 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-18 10:10:56,945 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 181 msec 2023-07-18 10:10:56,971 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-18 10:10:56,971 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-18 10:10:56,971 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-18 10:10:56,971 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:10:56,972 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:10:56,971 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:10:56,971 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-18 10:10:56,971 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:10:56,972 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-18 10:10:56,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-18 10:10:56,975 INFO [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-18 10:10:56,998 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-18 10:10:57,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:57,004 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-18 10:10:57,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-18 10:10:57,036 INFO [Listener at jenkins-hbase4.apache.org/42677] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=758 (was 708) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1314676217_17 at /127.0.0.1:54266 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1314676217_17 at /127.0.0.1:54690 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x56f36059-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/cluster_c337c4fc-2ada-e3f9-7d55-d4eaef1ef56e/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/cluster_c337c4fc-2ada-e3f9-7d55-d4eaef1ef56e/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x56f36059-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/cluster_c337c4fc-2ada-e3f9-7d55-d4eaef1ef56e/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x56f36059-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1002578752_1 at /127.0.0.1:54676 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/cluster_c337c4fc-2ada-e3f9-7d55-d4eaef1ef56e/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1283 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1002578752_1 at /127.0.0.1:36814 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1314676217_17 at /127.0.0.1:36824 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (274932937) connection to jenkins-hbase4.apache.org/172.31.14.131:33521 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (274932937) connection to jenkins-hbase4.apache.org/172.31.14.131:43719 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/cluster_c337c4fc-2ada-e3f9-7d55-d4eaef1ef56e/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x56f36059-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (274932937) connection to jenkins-hbase4.apache.org/172.31.14.131:40053 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/cluster_c337c4fc-2ada-e3f9-7d55-d4eaef1ef56e/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=935 (was 913) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=351 (was 321) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 177) - ProcessCount LEAK? -, AvailableMemoryMB=3203 (was 4831) 2023-07-18 10:10:57,037 WARN [Listener at jenkins-hbase4.apache.org/42677] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-07-18 10:10:57,057 INFO [Listener at jenkins-hbase4.apache.org/42677] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=758, OpenFileDescriptor=935, MaxFileDescriptor=60000, SystemLoadAverage=351, ProcessCount=183, AvailableMemoryMB=3202 2023-07-18 10:10:57,057 WARN [Listener at jenkins-hbase4.apache.org/42677] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-07-18 10:10:57,059 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-18 10:10:57,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-18 10:10:57,064 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 10:10:57,064 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-18 10:10:57,065 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 10:10:57,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-18 10:10:57,068 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemState/263cc296e8a2c05c1791317b46cc0acc 2023-07-18 10:10:57,068 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemState/5cf634642659040340571fa9df988c94 2023-07-18 10:10:57,069 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemState/263cc296e8a2c05c1791317b46cc0acc empty. 2023-07-18 10:10:57,069 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemState/5cf634642659040340571fa9df988c94 empty. 2023-07-18 10:10:57,069 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemState/263cc296e8a2c05c1791317b46cc0acc 2023-07-18 10:10:57,069 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemState/5cf634642659040340571fa9df988c94 2023-07-18 10:10:57,069 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-18 10:10:57,086 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-18 10:10:57,088 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 5cf634642659040340571fa9df988c94, NAME => 'testtb-testExportFileSystemState,1,1689675057058.5cf634642659040340571fa9df988c94.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp 2023-07-18 10:10:57,088 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 263cc296e8a2c05c1791317b46cc0acc, NAME => 'testtb-testExportFileSystemState,,1689675057058.263cc296e8a2c05c1791317b46cc0acc.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp 2023-07-18 10:10:57,110 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689675057058.263cc296e8a2c05c1791317b46cc0acc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:10:57,111 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 263cc296e8a2c05c1791317b46cc0acc, disabling compactions & flushes 2023-07-18 10:10:57,111 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689675057058.263cc296e8a2c05c1791317b46cc0acc. 2023-07-18 10:10:57,111 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689675057058.263cc296e8a2c05c1791317b46cc0acc. 2023-07-18 10:10:57,111 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689675057058.263cc296e8a2c05c1791317b46cc0acc. after waiting 0 ms 2023-07-18 10:10:57,111 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689675057058.263cc296e8a2c05c1791317b46cc0acc. 2023-07-18 10:10:57,111 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689675057058.263cc296e8a2c05c1791317b46cc0acc. 2023-07-18 10:10:57,111 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 263cc296e8a2c05c1791317b46cc0acc: 2023-07-18 10:10:57,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-18 10:10:57,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-18 10:10:57,516 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689675057058.5cf634642659040340571fa9df988c94.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:10:57,516 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 5cf634642659040340571fa9df988c94, disabling compactions & flushes 2023-07-18 10:10:57,516 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689675057058.5cf634642659040340571fa9df988c94. 2023-07-18 10:10:57,516 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689675057058.5cf634642659040340571fa9df988c94. 2023-07-18 10:10:57,516 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689675057058.5cf634642659040340571fa9df988c94. after waiting 0 ms 2023-07-18 10:10:57,516 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689675057058.5cf634642659040340571fa9df988c94. 2023-07-18 10:10:57,516 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689675057058.5cf634642659040340571fa9df988c94. 2023-07-18 10:10:57,516 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 5cf634642659040340571fa9df988c94: 2023-07-18 10:10:57,519 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 10:10:57,520 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689675057058.263cc296e8a2c05c1791317b46cc0acc.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689675057520"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689675057520"}]},"ts":"1689675057520"} 2023-07-18 10:10:57,521 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689675057058.5cf634642659040340571fa9df988c94.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689675057520"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689675057520"}]},"ts":"1689675057520"} 2023-07-18 10:10:57,523 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-18 10:10:57,524 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 10:10:57,524 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689675057524"}]},"ts":"1689675057524"} 2023-07-18 10:10:57,525 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-18 10:10:57,618 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 10:10:57,619 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 10:10:57,619 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 10:10:57,619 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 10:10:57,619 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 10:10:57,619 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=263cc296e8a2c05c1791317b46cc0acc, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5cf634642659040340571fa9df988c94, ASSIGN}] 2023-07-18 10:10:57,623 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=263cc296e8a2c05c1791317b46cc0acc, ASSIGN 2023-07-18 10:10:57,623 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5cf634642659040340571fa9df988c94, ASSIGN 2023-07-18 10:10:57,624 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=263cc296e8a2c05c1791317b46cc0acc, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34221,1689675027589; forceNewPlan=false, retain=false 2023-07-18 10:10:57,624 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5cf634642659040340571fa9df988c94, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40089,1689675027524; forceNewPlan=false, retain=false 2023-07-18 10:10:57,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-18 10:10:57,774 INFO [jenkins-hbase4:46557] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-18 10:10:57,777 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=263cc296e8a2c05c1791317b46cc0acc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:57,777 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=5cf634642659040340571fa9df988c94, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:57,777 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689675057058.263cc296e8a2c05c1791317b46cc0acc.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689675057776"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689675057776"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689675057776"}]},"ts":"1689675057776"} 2023-07-18 10:10:57,777 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689675057058.5cf634642659040340571fa9df988c94.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689675057776"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689675057776"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689675057776"}]},"ts":"1689675057776"} 2023-07-18 10:10:57,780 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure 263cc296e8a2c05c1791317b46cc0acc, server=jenkins-hbase4.apache.org,34221,1689675027589}] 2023-07-18 10:10:57,781 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure 5cf634642659040340571fa9df988c94, server=jenkins-hbase4.apache.org,40089,1689675027524}] 2023-07-18 10:10:57,940 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689675057058.263cc296e8a2c05c1791317b46cc0acc. 2023-07-18 10:10:57,941 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 263cc296e8a2c05c1791317b46cc0acc, NAME => 'testtb-testExportFileSystemState,,1689675057058.263cc296e8a2c05c1791317b46cc0acc.', STARTKEY => '', ENDKEY => '1'} 2023-07-18 10:10:57,941 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689675057058.263cc296e8a2c05c1791317b46cc0acc. service=AccessControlService 2023-07-18 10:10:57,941 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 10:10:57,941 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 263cc296e8a2c05c1791317b46cc0acc 2023-07-18 10:10:57,941 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689675057058.5cf634642659040340571fa9df988c94. 2023-07-18 10:10:57,941 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689675057058.263cc296e8a2c05c1791317b46cc0acc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:10:57,941 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5cf634642659040340571fa9df988c94, NAME => 'testtb-testExportFileSystemState,1,1689675057058.5cf634642659040340571fa9df988c94.', STARTKEY => '1', ENDKEY => ''} 2023-07-18 10:10:57,941 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 263cc296e8a2c05c1791317b46cc0acc 2023-07-18 10:10:57,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 263cc296e8a2c05c1791317b46cc0acc 2023-07-18 10:10:57,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689675057058.5cf634642659040340571fa9df988c94. service=AccessControlService 2023-07-18 10:10:57,942 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 10:10:57,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 5cf634642659040340571fa9df988c94 2023-07-18 10:10:57,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689675057058.5cf634642659040340571fa9df988c94.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:10:57,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5cf634642659040340571fa9df988c94 2023-07-18 10:10:57,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5cf634642659040340571fa9df988c94 2023-07-18 10:10:57,943 INFO [StoreOpener-263cc296e8a2c05c1791317b46cc0acc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 263cc296e8a2c05c1791317b46cc0acc 2023-07-18 10:10:57,944 INFO [StoreOpener-5cf634642659040340571fa9df988c94-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5cf634642659040340571fa9df988c94 2023-07-18 10:10:57,945 DEBUG [StoreOpener-263cc296e8a2c05c1791317b46cc0acc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemState/263cc296e8a2c05c1791317b46cc0acc/cf 2023-07-18 10:10:57,945 DEBUG [StoreOpener-263cc296e8a2c05c1791317b46cc0acc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemState/263cc296e8a2c05c1791317b46cc0acc/cf 2023-07-18 10:10:57,946 DEBUG [StoreOpener-5cf634642659040340571fa9df988c94-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemState/5cf634642659040340571fa9df988c94/cf 2023-07-18 10:10:57,946 INFO [StoreOpener-263cc296e8a2c05c1791317b46cc0acc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 263cc296e8a2c05c1791317b46cc0acc columnFamilyName cf 2023-07-18 10:10:57,946 DEBUG [StoreOpener-5cf634642659040340571fa9df988c94-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemState/5cf634642659040340571fa9df988c94/cf 2023-07-18 10:10:57,946 INFO [StoreOpener-5cf634642659040340571fa9df988c94-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5cf634642659040340571fa9df988c94 columnFamilyName cf 2023-07-18 10:10:57,946 INFO [StoreOpener-263cc296e8a2c05c1791317b46cc0acc-1] regionserver.HStore(310): Store=263cc296e8a2c05c1791317b46cc0acc/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 10:10:57,948 INFO [StoreOpener-5cf634642659040340571fa9df988c94-1] regionserver.HStore(310): Store=5cf634642659040340571fa9df988c94/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 10:10:57,950 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemState/263cc296e8a2c05c1791317b46cc0acc 2023-07-18 10:10:57,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemState/263cc296e8a2c05c1791317b46cc0acc 2023-07-18 10:10:57,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemState/5cf634642659040340571fa9df988c94 2023-07-18 10:10:57,952 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemState/5cf634642659040340571fa9df988c94 2023-07-18 10:10:57,954 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 263cc296e8a2c05c1791317b46cc0acc 2023-07-18 10:10:57,956 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5cf634642659040340571fa9df988c94 2023-07-18 10:10:57,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemState/263cc296e8a2c05c1791317b46cc0acc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 10:10:57,958 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 263cc296e8a2c05c1791317b46cc0acc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68678420, jitterRate=0.023388206958770752}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 10:10:57,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 263cc296e8a2c05c1791317b46cc0acc: 2023-07-18 10:10:57,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemState/5cf634642659040340571fa9df988c94/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 10:10:57,959 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5cf634642659040340571fa9df988c94; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67961056, jitterRate=0.012698650360107422}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 10:10:57,959 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689675057058.263cc296e8a2c05c1791317b46cc0acc., pid=30, masterSystemTime=1689675057932 2023-07-18 10:10:57,959 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5cf634642659040340571fa9df988c94: 2023-07-18 10:10:57,960 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689675057058.5cf634642659040340571fa9df988c94., pid=31, masterSystemTime=1689675057933 2023-07-18 10:10:57,961 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689675057058.263cc296e8a2c05c1791317b46cc0acc. 2023-07-18 10:10:57,961 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689675057058.263cc296e8a2c05c1791317b46cc0acc. 2023-07-18 10:10:57,962 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=263cc296e8a2c05c1791317b46cc0acc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:57,962 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689675057058.5cf634642659040340571fa9df988c94. 2023-07-18 10:10:57,962 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689675057058.5cf634642659040340571fa9df988c94. 2023-07-18 10:10:57,962 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689675057058.263cc296e8a2c05c1791317b46cc0acc.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689675057962"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689675057962"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689675057962"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689675057962"}]},"ts":"1689675057962"} 2023-07-18 10:10:57,963 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=5cf634642659040340571fa9df988c94, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:57,963 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689675057058.5cf634642659040340571fa9df988c94.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689675057963"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689675057963"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689675057963"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689675057963"}]},"ts":"1689675057963"} 2023-07-18 10:10:57,968 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=28 2023-07-18 10:10:57,969 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure 263cc296e8a2c05c1791317b46cc0acc, server=jenkins-hbase4.apache.org,34221,1689675027589 in 185 msec 2023-07-18 10:10:57,970 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=29 2023-07-18 10:10:57,972 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure 5cf634642659040340571fa9df988c94, server=jenkins-hbase4.apache.org,40089,1689675027524 in 185 msec 2023-07-18 10:10:57,973 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=263cc296e8a2c05c1791317b46cc0acc, ASSIGN in 349 msec 2023-07-18 10:10:57,976 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=27 2023-07-18 10:10:57,976 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5cf634642659040340571fa9df988c94, ASSIGN in 353 msec 2023-07-18 10:10:57,977 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 10:10:57,978 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689675057977"}]},"ts":"1689675057977"} 2023-07-18 10:10:57,980 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-18 10:10:58,042 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 10:10:58,043 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-18 10:10:58,045 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34221] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-18 10:10:58,064 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:10:58,064 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:10:58,064 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:10:58,064 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:10:58,095 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-18 10:10:58,095 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-18 10:10:58,095 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-18 10:10:58,095 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-18 10:10:58,097 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 1.0350 sec 2023-07-18 10:10:58,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-18 10:10:58,172 INFO [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-18 10:10:58,172 DEBUG [Listener at jenkins-hbase4.apache.org/42677] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemState get assigned. Timeout = 60000ms 2023-07-18 10:10:58,172 INFO [Listener at jenkins-hbase4.apache.org/42677] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 10:10:58,175 INFO [Listener at jenkins-hbase4.apache.org/42677] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemState assigned to meta. Checking AM states. 2023-07-18 10:10:58,176 INFO [Listener at jenkins-hbase4.apache.org/42677] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 10:10:58,176 INFO [Listener at jenkins-hbase4.apache.org/42677] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemState assigned. 2023-07-18 10:10:58,179 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 10:10:58,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689675058179 (current time:1689675058179). 2023-07-18 10:10:58,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 10:10:58,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] zookeeper.ReadOnlyZKClient(139): Connect 0x4cdbf2f3 to 127.0.0.1:56089 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 10:10:58,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6714d567, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 10:10:58,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:10:58,188 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56172, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:10:58,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4cdbf2f3 to 127.0.0.1:56089 2023-07-18 10:10:58,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 10:10:58,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] zookeeper.ReadOnlyZKClient(139): Connect 0x306a03e2 to 127.0.0.1:56089 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 10:10:58,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@23b52376, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 10:10:58,196 DEBUG [hconnection-0x62cb658a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:10:58,199 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56180, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:10:58,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:10:58,204 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33086, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:10:58,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x306a03e2 to 127.0.0.1:56089 2023-07-18 10:10:58,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 10:10:58,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-18 10:10:58,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 10:10:58,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 10:10:58,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-18 10:10:58,218 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-18 10:10:58,219 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689675658219 2023-07-18 10:10:58,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 10:10:58,219 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-18 10:10:58,221 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 10:10:58,221 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 10:10:58,223 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-18 10:10:58,223 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-18 10:10:58,225 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 9 msec 2023-07-18 10:10:58,226 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-18 10:10:58,227 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689675658227 2023-07-18 10:10:58,245 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,245 INFO [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-18 10:10:58,245 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:10:58,247 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-18 10:10:58,247 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-18 10:10:58,247 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,247 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,249 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:10:58,249 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:58,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:10:58,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:10:58,249 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:10:58,249 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:10:58,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:10:58,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:10:58,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:10:58,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:10:58,249 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:58,249 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:58,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,250 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,250 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,250 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,250 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:58,250 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 10:10:58,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-18 10:10:58,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-18 10:10:58,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-18 10:10:58,251 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-18 10:10:58,251 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-18 10:10:58,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,251 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,251 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-18 10:10:58,251 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-18 10:10:58,251 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:10:58,251 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,257 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-18 10:10:58,257 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-18 10:10:58,251 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,257 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:10:58,257 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-18 10:10:58,257 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40089,1689675027524' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-18 10:10:58,258 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-18 10:10:58,258 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-18 10:10:58,257 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-18 10:10:58,258 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34221,1689675027589' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-18 10:10:58,258 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:10:58,259 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-18 10:10:58,260 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-18 10:10:58,260 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33757,1689675027667' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-18 10:10:58,261 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:58,261 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:58,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:10:58,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:10:58,267 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:58,267 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,267 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,267 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:10:58,267 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,268 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:10:58,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:10:58,267 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:10:58,268 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,268 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:10:58,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:58,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:58,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:58,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:10:58,270 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40089,1689675027524' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-18 10:10:58,270 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@681912ce[Count = 1] remaining members to acquire global barrier 2023-07-18 10:10:58,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:58,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:10:58,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:10:58,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:10:58,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:10:58,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:58,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:58,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:58,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:10:58,273 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34221,1689675027589' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-18 10:10:58,273 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@681912ce[Count = 0] remaining members to acquire global barrier 2023-07-18 10:10:58,273 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-18 10:10:58,273 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,274 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,274 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,274 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,274 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:58,274 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-18 10:10:58,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,274 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-18 10:10:58,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,274 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 10:10:58,275 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:58,275 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 10:10:58,275 DEBUG [rs(jenkins-hbase4.apache.org,40089,1689675027524)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689675057058.5cf634642659040340571fa9df988c94. 2023-07-18 10:10:58,275 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689675057058.263cc296e8a2c05c1791317b46cc0acc. 2023-07-18 10:10:58,275 DEBUG [rs(jenkins-hbase4.apache.org,40089,1689675027524)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689675057058.5cf634642659040340571fa9df988c94. started... 2023-07-18 10:10:58,275 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689675057058.263cc296e8a2c05c1791317b46cc0acc. started... 2023-07-18 10:10:58,275 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-18 10:10:58,275 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-18 10:10:58,275 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33757,1689675027667' in zk 2023-07-18 10:10:58,275 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 10:10:58,276 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 10:10:58,275 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 10:10:58,276 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 263cc296e8a2c05c1791317b46cc0acc: 2023-07-18 10:10:58,276 DEBUG [rs(jenkins-hbase4.apache.org,40089,1689675027524)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5cf634642659040340571fa9df988c94: 2023-07-18 10:10:58,277 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689675057058.263cc296e8a2c05c1791317b46cc0acc.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,277 DEBUG [rs(jenkins-hbase4.apache.org,40089,1689675027524)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689675057058.5cf634642659040340571fa9df988c94.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,277 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 10:10:58,277 DEBUG [rs(jenkins-hbase4.apache.org,40089,1689675027524)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 10:10:58,277 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 10:10:58,277 DEBUG [rs(jenkins-hbase4.apache.org,40089,1689675027524)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 10:10:58,278 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-18 10:10:58,278 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:10:58,278 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-18 10:10:58,301 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689675057058.263cc296e8a2c05c1791317b46cc0acc. completed. 2023-07-18 10:10:58,301 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689675057058.263cc296e8a2c05c1791317b46cc0acc. 2023-07-18 10:10:58,301 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 10:10:58,301 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 10:10:58,301 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:58,301 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-18 10:10:58,301 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34221,1689675027589' in zk 2023-07-18 10:10:58,304 DEBUG [rs(jenkins-hbase4.apache.org,40089,1689675027524)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689675057058.5cf634642659040340571fa9df988c94. completed. 2023-07-18 10:10:58,304 DEBUG [rs(jenkins-hbase4.apache.org,40089,1689675027524)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689675057058.5cf634642659040340571fa9df988c94. 2023-07-18 10:10:58,304 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 10:10:58,304 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 10:10:58,304 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:58,304 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-18 10:10:58,304 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40089,1689675027524' in zk 2023-07-18 10:10:58,305 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:58,305 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-18 10:10:58,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:58,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:10:58,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:10:58,306 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:10:58,306 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-18 10:10:58,307 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-18 10:10:58,308 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:58,308 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:10:58,308 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-18 10:10:58,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:10:58,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:10:58,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:58,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:58,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:58,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:10:58,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:58,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:58,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:58,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,34221,1689675027589': 2023-07-18 10:10:58,314 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34221,1689675027589' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-18 10:10:58,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:58,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:10:58,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:10:58,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:10:58,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:10:58,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:58,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:58,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:58,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:10:58,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:58,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:58,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:58,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,40089,1689675027524': 2023-07-18 10:10:58,321 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40089,1689675027524' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-18 10:10:58,321 INFO [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-18 10:10:58,321 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 10:10:58,321 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 10:10:58,321 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,321 INFO [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 10:10:58,321 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 10:10:58,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 10:10:58,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-18 10:10:58,323 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 10:10:58,325 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,325 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,325 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,325 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:10:58,325 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:10:58,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,325 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:10:58,325 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:10:58,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:10:58,326 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:58,326 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:10:58,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:10:58,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:10:58,326 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:10:58,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:10:58,327 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:58,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:10:58,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:10:58,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,327 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:58,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:10:58,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:58,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:58,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:58,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:10:58,330 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:58,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,331 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:58,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:58,331 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:58,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:58,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:58,335 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:10:58,335 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:10:58,335 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:58,335 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:10:58,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:10:58,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:10:58,335 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:10:58,335 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:10:58,335 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:10:58,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:10:58,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:10:58,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:10:58,335 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,336 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:10:58,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:10:58,335 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,335 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:10:58,336 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:10:58,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:10:58,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:10:58,336 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:58,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:10:58,338 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:58,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:10:58,338 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,338 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:58,338 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,338 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:58,338 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:58,338 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,338 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,338 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,363 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,388 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-18 10:10:58,388 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,388 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,388 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689675058220Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689675058336 (+116 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689675058337 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689675058342 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689675058355 (+13 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689675058388 (+33 ms) 2023-07-18 10:10:58,391 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-18 10:10:58,394 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 170 msec 2023-07-18 10:10:58,523 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 10:10:58,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 10:10:58,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 10:10:58,535 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34221] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689675057058.263cc296e8a2c05c1791317b46cc0acc. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 10:10:58,537 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40089] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689675057058.5cf634642659040340571fa9df988c94. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 10:10:58,541 DEBUG [Listener at jenkins-hbase4.apache.org/42677] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-18 10:10:58,542 DEBUG [Listener at jenkins-hbase4.apache.org/42677] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689675057058.263cc296e8a2c05c1791317b46cc0acc. 2023-07-18 10:10:58,543 INFO [Listener at jenkins-hbase4.apache.org/42677] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 10:10:58,568 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 10:10:58,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689675058568 (current time:1689675058568). 2023-07-18 10:10:58,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 10:10:58,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] zookeeper.ReadOnlyZKClient(139): Connect 0x20fdc25e to 127.0.0.1:56089 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 10:10:58,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@41a8ae4e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 10:10:58,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:10:58,585 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56186, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:10:58,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x20fdc25e to 127.0.0.1:56089 2023-07-18 10:10:58,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 10:10:58,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] zookeeper.ReadOnlyZKClient(139): Connect 0x6adb6415 to 127.0.0.1:56089 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 10:10:58,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@20a4a42d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 10:10:58,601 DEBUG [hconnection-0x74ebec79-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:10:58,602 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56196, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:10:58,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:10:58,611 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33102, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:10:58,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6adb6415 to 127.0.0.1:56089 2023-07-18 10:10:58,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 10:10:58,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-18 10:10:58,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 10:10:58,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 10:10:58,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-18 10:10:58,618 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-18 10:10:58,620 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689675658620 2023-07-18 10:10:58,620 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-18 10:10:58,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 10:10:58,622 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 10:10:58,622 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 10:10:58,623 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-18 10:10:58,626 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-18 10:10:58,628 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 11 msec 2023-07-18 10:10:58,630 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-18 10:10:58,630 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689675658630 2023-07-18 10:10:58,653 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-18 10:10:58,653 INFO [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-18 10:10:58,653 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:10:58,655 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-18 10:10:58,655 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-18 10:10:58,656 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,656 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,659 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:10:58,659 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:10:58,659 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:10:58,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:10:58,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:10:58,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:10:58,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:10:58,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,660 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:10:58,660 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,659 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:58,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:10:58,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-18 10:10:58,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,662 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:58,662 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:58,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-18 10:10:58,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,663 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-18 10:10:58,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,663 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-18 10:10:58,663 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,664 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:58,664 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 10:10:58,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-18 10:10:58,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,665 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-18 10:10:58,666 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-18 10:10:58,667 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-18 10:10:58,667 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:10:58,678 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-18 10:10:58,679 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-18 10:10:58,679 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:10:58,682 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-18 10:10:58,692 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-18 10:10:58,692 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-18 10:10:58,692 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-18 10:10:58,692 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-18 10:10:58,692 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:10:58,692 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-18 10:10:58,692 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34221,1689675027589' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-18 10:10:58,692 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40089,1689675027524' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-18 10:10:58,694 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-18 10:10:58,695 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-18 10:10:58,695 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33757,1689675027667' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-18 10:10:58,697 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,697 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,698 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,698 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,698 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,698 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:10:58,698 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:10:58,698 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,698 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:10:58,700 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:58,700 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:58,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:58,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:10:58,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:10:58,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:10:58,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:10:58,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-18 10:10:58,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:58,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:58,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:58,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:10:58,703 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34221,1689675027589' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-18 10:10:58,703 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@446fe248[Count = 1] remaining members to acquire global barrier 2023-07-18 10:10:58,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:58,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:10:58,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:10:58,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:10:58,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:10:58,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-18 10:10:58,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:58,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:58,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:58,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:10:58,709 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40089,1689675027524' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-18 10:10:58,709 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@446fe248[Count = 0] remaining members to acquire global barrier 2023-07-18 10:10:58,709 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-18 10:10:58,709 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,711 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,711 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,711 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,711 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-18 10:10:58,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,711 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-18 10:10:58,711 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-18 10:10:58,711 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33757,1689675027667' in zk 2023-07-18 10:10:58,711 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 10:10:58,712 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689675057058.263cc296e8a2c05c1791317b46cc0acc. 2023-07-18 10:10:58,712 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 10:10:58,712 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689675057058.263cc296e8a2c05c1791317b46cc0acc. started... 2023-07-18 10:10:58,712 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-18 10:10:58,712 INFO [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 263cc296e8a2c05c1791317b46cc0acc 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-18 10:10:58,712 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:58,715 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-18 10:10:58,715 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:10:58,715 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-18 10:10:58,716 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:58,716 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 10:10:58,718 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 10:10:58,720 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 10:10:58,720 DEBUG [rs(jenkins-hbase4.apache.org,40089,1689675027524)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689675057058.5cf634642659040340571fa9df988c94. 2023-07-18 10:10:58,720 DEBUG [rs(jenkins-hbase4.apache.org,40089,1689675027524)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689675057058.5cf634642659040340571fa9df988c94. started... 2023-07-18 10:10:58,720 INFO [rs(jenkins-hbase4.apache.org,40089,1689675027524)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 5cf634642659040340571fa9df988c94 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-18 10:10:58,722 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 10:10:58,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 10:10:58,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-18 10:10:58,728 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 10:10:58,784 INFO [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=266 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemState/263cc296e8a2c05c1791317b46cc0acc/.tmp/cf/0c9144c6e6744f48b03abe9811774486 2023-07-18 10:10:58,799 INFO [rs(jenkins-hbase4.apache.org,40089,1689675027524)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.00 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemState/5cf634642659040340571fa9df988c94/.tmp/cf/2290043e42b04f20b3b8985c3ab7e382 2023-07-18 10:10:58,801 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemState/263cc296e8a2c05c1791317b46cc0acc/.tmp/cf/0c9144c6e6744f48b03abe9811774486 as hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemState/263cc296e8a2c05c1791317b46cc0acc/cf/0c9144c6e6744f48b03abe9811774486 2023-07-18 10:10:58,811 INFO [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemState/263cc296e8a2c05c1791317b46cc0acc/cf/0c9144c6e6744f48b03abe9811774486, entries=4, sequenceid=6, filesize=5.1 K 2023-07-18 10:10:58,812 INFO [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 263cc296e8a2c05c1791317b46cc0acc in 100ms, sequenceid=6, compaction requested=false 2023-07-18 10:10:58,812 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-18 10:10:58,813 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 263cc296e8a2c05c1791317b46cc0acc: 2023-07-18 10:10:58,813 DEBUG [rs(jenkins-hbase4.apache.org,40089,1689675027524)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemState/5cf634642659040340571fa9df988c94/.tmp/cf/2290043e42b04f20b3b8985c3ab7e382 as hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemState/5cf634642659040340571fa9df988c94/cf/2290043e42b04f20b3b8985c3ab7e382 2023-07-18 10:10:58,815 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689675057058.263cc296e8a2c05c1791317b46cc0acc.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-18 10:10:58,815 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 10:10:58,815 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemState/263cc296e8a2c05c1791317b46cc0acc/cf/0c9144c6e6744f48b03abe9811774486] hfiles 2023-07-18 10:10:58,815 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemState/263cc296e8a2c05c1791317b46cc0acc/cf/0c9144c6e6744f48b03abe9811774486 for snapshot=snaptb0-testExportFileSystemState 2023-07-18 10:10:58,823 INFO [rs(jenkins-hbase4.apache.org,40089,1689675027524)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemState/5cf634642659040340571fa9df988c94/cf/2290043e42b04f20b3b8985c3ab7e382, entries=46, sequenceid=6, filesize=7.9 K 2023-07-18 10:10:58,839 INFO [rs(jenkins-hbase4.apache.org,40089,1689675027524)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 5cf634642659040340571fa9df988c94 in 119ms, sequenceid=6, compaction requested=false 2023-07-18 10:10:58,876 DEBUG [rs(jenkins-hbase4.apache.org,40089,1689675027524)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5cf634642659040340571fa9df988c94: 2023-07-18 10:10:58,876 DEBUG [rs(jenkins-hbase4.apache.org,40089,1689675027524)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689675057058.5cf634642659040340571fa9df988c94.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-18 10:10:58,877 DEBUG [rs(jenkins-hbase4.apache.org,40089,1689675027524)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 10:10:58,877 DEBUG [rs(jenkins-hbase4.apache.org,40089,1689675027524)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemState/5cf634642659040340571fa9df988c94/cf/2290043e42b04f20b3b8985c3ab7e382] hfiles 2023-07-18 10:10:58,877 DEBUG [rs(jenkins-hbase4.apache.org,40089,1689675027524)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemState/5cf634642659040340571fa9df988c94/cf/2290043e42b04f20b3b8985c3ab7e382 for snapshot=snaptb0-testExportFileSystemState 2023-07-18 10:10:58,882 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689675057058.263cc296e8a2c05c1791317b46cc0acc. completed. 2023-07-18 10:10:58,882 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689675057058.263cc296e8a2c05c1791317b46cc0acc. 2023-07-18 10:10:58,882 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 10:10:58,882 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 10:10:58,882 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:58,883 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-18 10:10:58,883 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34221,1689675027589' in zk 2023-07-18 10:10:58,892 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-18 10:10:58,892 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:58,892 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:10:58,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:58,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:10:58,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:10:58,892 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-18 10:10:58,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:10:58,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:10:58,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-18 10:10:58,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:58,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:58,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:58,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:10:58,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-18 10:10:58,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:58,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:58,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,34221,1689675027589': 2023-07-18 10:10:58,901 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34221,1689675027589' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-18 10:10:58,910 DEBUG [rs(jenkins-hbase4.apache.org,40089,1689675027524)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689675057058.5cf634642659040340571fa9df988c94. completed. 2023-07-18 10:10:58,910 DEBUG [rs(jenkins-hbase4.apache.org,40089,1689675027524)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689675057058.5cf634642659040340571fa9df988c94. 2023-07-18 10:10:58,910 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 10:10:58,910 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 10:10:58,910 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:58,910 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-18 10:10:58,910 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40089,1689675027524' in zk 2023-07-18 10:10:58,913 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-18 10:10:58,914 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:58,914 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:10:58,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:58,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:10:58,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:10:58,914 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-18 10:10:58,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:10:58,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:10:58,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-18 10:10:58,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:58,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:58,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:58,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:10:58,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-18 10:10:58,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:58,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:58,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:58,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,40089,1689675027524': 2023-07-18 10:10:58,921 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40089,1689675027524' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-18 10:10:58,921 INFO [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-18 10:10:58,921 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 10:10:58,921 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 10:10:58,921 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-18 10:10:58,921 INFO [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 10:10:58,924 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,924 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:10:58,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,924 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:10:58,924 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,924 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,924 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:10:58,924 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:10:58,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:10:58,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:10:58,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:10:58,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:10:58,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,925 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:58,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:10:58,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:10:58,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:10:58,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,928 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 10:10:58,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:10:58,929 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:58,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-18 10:10:58,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 10:10:58,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-18 10:10:58,929 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:58,930 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-18 10:10:58,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:10:58,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-18 10:10:58,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:58,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:58,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:58,936 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:58,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:10:58,937 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:58,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-18 10:10:58,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:58,938 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:58,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:58,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:58,945 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:10:58,945 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:58,945 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:10:58,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:10:58,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:10:58,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:10:58,945 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:10:58,946 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:10:58,946 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:10:58,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:10:58,946 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:10:58,945 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:10:58,945 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,948 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:58,948 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:58,948 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,948 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:10:58,948 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,948 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:10:58,948 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:10:58,948 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,948 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:10:58,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:10:58,948 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:10:58,946 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-18 10:10:58,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:10:58,948 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-18 10:10:58,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:10:58,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:10:58,948 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:10:58,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:10:58,949 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-18 10:10:59,029 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-18 10:10:59,067 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-18 10:10:59,067 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-18 10:10:59,068 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-18 10:10:59,068 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689675058620Consolidate snapshot: snaptb0-testExportFileSystemState at 1689675058948 (+328 ms)Loading Region manifests for snaptb0-testExportFileSystemState at 1689675058948Writing data manifest for snaptb0-testExportFileSystemState at 1689675058959 (+11 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689675059020 (+61 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689675059067 (+47 ms) 2023-07-18 10:10:59,072 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-18 10:10:59,074 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 450 msec 2023-07-18 10:10:59,230 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 10:10:59,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 10:10:59,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 10:10:59,233 INFO [Listener at jenkins-hbase4.apache.org/42677] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/export-test/export-1689675059233 2023-07-18 10:10:59,233 INFO [Listener at jenkins-hbase4.apache.org/42677] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35953, tgtDir=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/export-test/export-1689675059233, rawTgtDir=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/export-test/export-1689675059233, srcFsUri=hdfs://localhost:35953, srcDir=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336 2023-07-18 10:10:59,262 DEBUG [Listener at jenkins-hbase4.apache.org/42677] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35953, inputRoot=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336 2023-07-18 10:10:59,262 DEBUG [Listener at jenkins-hbase4.apache.org/42677] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1380640207_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/export-test/export-1689675059233, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/export-test/export-1689675059233/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-18 10:10:59,262 INFO [Listener at jenkins-hbase4.apache.org/42677] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35953, inputRoot=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336, snapshotDir=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-18 10:10:59,285 INFO [Listener at jenkins-hbase4.apache.org/42677] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/export-test/export-1689675059233/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-18 10:10:59,354 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-18 10:10:59,355 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-18 10:10:59,355 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-18 10:10:59,356 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-18 10:10:59,356 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-18 10:10:59,356 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-18 10:10:59,357 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-18 10:10:59,434 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/hadoop-4973427419579240620.jar 2023-07-18 10:10:59,435 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-18 10:10:59,435 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-18 10:10:59,435 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-18 10:10:59,436 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-18 10:10:59,436 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-18 10:10:59,436 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-18 10:10:59,437 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-18 10:10:59,437 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-18 10:10:59,438 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-18 10:10:59,438 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-18 10:10:59,438 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-18 10:10:59,439 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-18 10:10:59,439 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-18 10:10:59,440 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-18 10:10:59,440 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-18 10:10:59,441 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-18 10:10:59,441 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 10:10:59,442 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 10:10:59,442 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 10:10:59,443 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 10:10:59,443 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 10:10:59,444 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 10:10:59,444 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 10:11:00,109 WARN [Listener at jenkins-hbase4.apache.org/42677] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-18 10:11:00,111 INFO [Listener at jenkins-hbase4.apache.org/42677] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-18 10:11:00,114 DEBUG [Listener at jenkins-hbase4.apache.org/42677] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-18 10:11:00,416 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 10:11:00,417 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 10:11:00,424 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689675035639_0001_000001 (auth:SIMPLE) 2023-07-18 10:11:01,219 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689675035639_0002_000001 (auth:SIMPLE) 2023-07-18 10:11:02,056 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-18 10:11:06,121 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689675035639_0002_000001 (auth:SIMPLE) 2023-07-18 10:11:08,366 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689675035639_0002_000001 (auth:SIMPLE) 2023-07-18 10:11:11,284 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689675035639_0002_000001 (auth:SIMPLE) 2023-07-18 10:11:12,350 INFO [Listener at jenkins-hbase4.apache.org/42677] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-18 10:11:12,351 INFO [Listener at jenkins-hbase4.apache.org/42677] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-18 10:11:12,358 INFO [Listener at jenkins-hbase4.apache.org/42677] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-18 10:11:12,358 INFO [Listener at jenkins-hbase4.apache.org/42677] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-18 10:11:12,359 INFO [Listener at jenkins-hbase4.apache.org/42677] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-18 10:11:12,359 DEBUG [Listener at jenkins-hbase4.apache.org/42677] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1314676217_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-18 10:11:12,359 DEBUG [Listener at jenkins-hbase4.apache.org/42677] snapshot.TestExportSnapshot(367): hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-18 10:11:12,359 DEBUG [Listener at jenkins-hbase4.apache.org/42677] snapshot.TestExportSnapshot(367): hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-18 10:11:12,359 DEBUG [Listener at jenkins-hbase4.apache.org/42677] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1314676217_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/export-test/export-1689675059233/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/export-test/export-1689675059233/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-18 10:11:12,360 DEBUG [Listener at jenkins-hbase4.apache.org/42677] snapshot.TestExportSnapshot(367): hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/export-test/export-1689675059233/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-18 10:11:12,360 DEBUG [Listener at jenkins-hbase4.apache.org/42677] snapshot.TestExportSnapshot(367): hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/export-test/export-1689675059233/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-18 10:11:12,368 INFO [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-18 10:11:12,368 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-18 10:11:12,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-18 10:11:12,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-18 10:11:12,376 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689675072376"}]},"ts":"1689675072376"} 2023-07-18 10:11:12,378 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-18 10:11:12,379 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-18 10:11:12,380 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=263cc296e8a2c05c1791317b46cc0acc, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5cf634642659040340571fa9df988c94, UNASSIGN}] 2023-07-18 10:11:12,384 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=263cc296e8a2c05c1791317b46cc0acc, UNASSIGN 2023-07-18 10:11:12,384 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5cf634642659040340571fa9df988c94, UNASSIGN 2023-07-18 10:11:12,385 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=263cc296e8a2c05c1791317b46cc0acc, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:12,385 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689675057058.263cc296e8a2c05c1791317b46cc0acc.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689675072385"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689675072385"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689675072385"}]},"ts":"1689675072385"} 2023-07-18 10:11:12,386 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=5cf634642659040340571fa9df988c94, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:12,386 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689675057058.5cf634642659040340571fa9df988c94.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689675072386"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689675072386"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689675072386"}]},"ts":"1689675072386"} 2023-07-18 10:11:12,387 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure 263cc296e8a2c05c1791317b46cc0acc, server=jenkins-hbase4.apache.org,34221,1689675027589}] 2023-07-18 10:11:12,388 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure 5cf634642659040340571fa9df988c94, server=jenkins-hbase4.apache.org,40089,1689675027524}] 2023-07-18 10:11:12,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-18 10:11:12,539 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 263cc296e8a2c05c1791317b46cc0acc 2023-07-18 10:11:12,540 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5cf634642659040340571fa9df988c94 2023-07-18 10:11:12,540 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 263cc296e8a2c05c1791317b46cc0acc, disabling compactions & flushes 2023-07-18 10:11:12,540 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689675057058.263cc296e8a2c05c1791317b46cc0acc. 2023-07-18 10:11:12,540 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5cf634642659040340571fa9df988c94, disabling compactions & flushes 2023-07-18 10:11:12,540 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689675057058.263cc296e8a2c05c1791317b46cc0acc. 2023-07-18 10:11:12,540 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689675057058.5cf634642659040340571fa9df988c94. 2023-07-18 10:11:12,540 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689675057058.263cc296e8a2c05c1791317b46cc0acc. after waiting 0 ms 2023-07-18 10:11:12,540 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689675057058.5cf634642659040340571fa9df988c94. 2023-07-18 10:11:12,540 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689675057058.263cc296e8a2c05c1791317b46cc0acc. 2023-07-18 10:11:12,540 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689675057058.5cf634642659040340571fa9df988c94. after waiting 0 ms 2023-07-18 10:11:12,540 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689675057058.5cf634642659040340571fa9df988c94. 2023-07-18 10:11:12,554 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemState/263cc296e8a2c05c1791317b46cc0acc/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 10:11:12,554 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemState/5cf634642659040340571fa9df988c94/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 10:11:12,555 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 10:11:12,555 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 10:11:12,556 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689675057058.263cc296e8a2c05c1791317b46cc0acc. 2023-07-18 10:11:12,556 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689675057058.5cf634642659040340571fa9df988c94. 2023-07-18 10:11:12,556 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 263cc296e8a2c05c1791317b46cc0acc: 2023-07-18 10:11:12,556 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5cf634642659040340571fa9df988c94: 2023-07-18 10:11:12,558 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 263cc296e8a2c05c1791317b46cc0acc 2023-07-18 10:11:12,559 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=263cc296e8a2c05c1791317b46cc0acc, regionState=CLOSED 2023-07-18 10:11:12,559 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5cf634642659040340571fa9df988c94 2023-07-18 10:11:12,559 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689675057058.263cc296e8a2c05c1791317b46cc0acc.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689675072559"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689675072559"}]},"ts":"1689675072559"} 2023-07-18 10:11:12,560 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=5cf634642659040340571fa9df988c94, regionState=CLOSED 2023-07-18 10:11:12,560 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689675057058.5cf634642659040340571fa9df988c94.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689675072559"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689675072559"}]},"ts":"1689675072559"} 2023-07-18 10:11:12,563 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=37 2023-07-18 10:11:12,563 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure 263cc296e8a2c05c1791317b46cc0acc, server=jenkins-hbase4.apache.org,34221,1689675027589 in 174 msec 2023-07-18 10:11:12,565 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=263cc296e8a2c05c1791317b46cc0acc, UNASSIGN in 183 msec 2023-07-18 10:11:12,566 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=38 2023-07-18 10:11:12,566 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure 5cf634642659040340571fa9df988c94, server=jenkins-hbase4.apache.org,40089,1689675027524 in 175 msec 2023-07-18 10:11:12,569 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=36 2023-07-18 10:11:12,569 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5cf634642659040340571fa9df988c94, UNASSIGN in 186 msec 2023-07-18 10:11:12,570 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689675072570"}]},"ts":"1689675072570"} 2023-07-18 10:11:12,571 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-18 10:11:12,573 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-18 10:11:12,576 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 204 msec 2023-07-18 10:11:12,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-18 10:11:12,678 INFO [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-18 10:11:12,679 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-18 10:11:12,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-18 10:11:12,683 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-18 10:11:12,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-18 10:11:12,685 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-18 10:11:12,686 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34221] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-18 10:11:12,690 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-18 10:11:12,690 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-18 10:11:12,690 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-18 10:11:12,690 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-18 10:11:12,690 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-18 10:11:12,691 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-18 10:11:12,691 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-18 10:11:12,691 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemState/263cc296e8a2c05c1791317b46cc0acc 2023-07-18 10:11:12,691 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemState/5cf634642659040340571fa9df988c94 2023-07-18 10:11:12,692 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-18 10:11:12,692 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-18 10:11:12,692 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-18 10:11:12,692 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:11:12,692 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:11:12,692 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data null 2023-07-18 10:11:12,692 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:11:12,692 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-18 10:11:12,692 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:11:12,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-18 10:11:12,694 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemState/5cf634642659040340571fa9df988c94/cf, FileablePath, hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemState/5cf634642659040340571fa9df988c94/recovered.edits] 2023-07-18 10:11:12,694 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemState/263cc296e8a2c05c1791317b46cc0acc/cf, FileablePath, hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemState/263cc296e8a2c05c1791317b46cc0acc/recovered.edits] 2023-07-18 10:11:12,699 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemState/5cf634642659040340571fa9df988c94/cf/2290043e42b04f20b3b8985c3ab7e382 to hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/archive/data/default/testtb-testExportFileSystemState/5cf634642659040340571fa9df988c94/cf/2290043e42b04f20b3b8985c3ab7e382 2023-07-18 10:11:12,699 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemState/263cc296e8a2c05c1791317b46cc0acc/cf/0c9144c6e6744f48b03abe9811774486 to hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/archive/data/default/testtb-testExportFileSystemState/263cc296e8a2c05c1791317b46cc0acc/cf/0c9144c6e6744f48b03abe9811774486 2023-07-18 10:11:12,703 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemState/5cf634642659040340571fa9df988c94/recovered.edits/9.seqid to hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/archive/data/default/testtb-testExportFileSystemState/5cf634642659040340571fa9df988c94/recovered.edits/9.seqid 2023-07-18 10:11:12,705 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemState/263cc296e8a2c05c1791317b46cc0acc/recovered.edits/9.seqid to hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/archive/data/default/testtb-testExportFileSystemState/263cc296e8a2c05c1791317b46cc0acc/recovered.edits/9.seqid 2023-07-18 10:11:12,707 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemState/5cf634642659040340571fa9df988c94 2023-07-18 10:11:12,707 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemState/263cc296e8a2c05c1791317b46cc0acc 2023-07-18 10:11:12,707 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-18 10:11:12,710 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-18 10:11:12,712 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-18 10:11:12,715 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-18 10:11:12,716 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-18 10:11:12,716 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-18 10:11:12,716 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689675057058.263cc296e8a2c05c1791317b46cc0acc.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689675072716"}]},"ts":"9223372036854775807"} 2023-07-18 10:11:12,716 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689675057058.5cf634642659040340571fa9df988c94.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689675072716"}]},"ts":"9223372036854775807"} 2023-07-18 10:11:12,718 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-18 10:11:12,718 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 263cc296e8a2c05c1791317b46cc0acc, NAME => 'testtb-testExportFileSystemState,,1689675057058.263cc296e8a2c05c1791317b46cc0acc.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 5cf634642659040340571fa9df988c94, NAME => 'testtb-testExportFileSystemState,1,1689675057058.5cf634642659040340571fa9df988c94.', STARTKEY => '1', ENDKEY => ''}] 2023-07-18 10:11:12,718 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-18 10:11:12,718 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689675072718"}]},"ts":"9223372036854775807"} 2023-07-18 10:11:12,720 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-18 10:11:12,722 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-18 10:11:12,723 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 43 msec 2023-07-18 10:11:12,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-18 10:11:12,795 INFO [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-18 10:11:12,804 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-18 10:11:12,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-18 10:11:12,809 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-18 10:11:12,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-18 10:11:12,839 INFO [Listener at jenkins-hbase4.apache.org/42677] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=768 (was 758) Potentially hanging thread: hconnection-0x56f36059-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x56f36059-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x56f36059-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1314676217_17 at /127.0.0.1:49668 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x56f36059-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2039287698_1 at /127.0.0.1:49632 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2039287698_1 at /127.0.0.1:33116 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1314676217_17 at /127.0.0.1:46562 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (274932937) connection to jenkins-hbase4.apache.org/172.31.14.131:46571 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1314676217_17 at /127.0.0.1:33138 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2067 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=924 (was 935), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=399 (was 351) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 183), AvailableMemoryMB=2844 (was 3202) 2023-07-18 10:11:12,839 WARN [Listener at jenkins-hbase4.apache.org/42677] hbase.ResourceChecker(130): Thread=768 is superior to 500 2023-07-18 10:11:12,860 INFO [Listener at jenkins-hbase4.apache.org/42677] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=768, OpenFileDescriptor=924, MaxFileDescriptor=60000, SystemLoadAverage=399, ProcessCount=183, AvailableMemoryMB=2843 2023-07-18 10:11:12,860 WARN [Listener at jenkins-hbase4.apache.org/42677] hbase.ResourceChecker(130): Thread=768 is superior to 500 2023-07-18 10:11:12,862 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-18 10:11:12,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-18 10:11:12,867 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 10:11:12,867 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-18 10:11:12,868 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 10:11:12,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-18 10:11:12,870 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testConsecutiveExports/50b83e19e3ce10b35dc481de893da5ae 2023-07-18 10:11:12,870 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testConsecutiveExports/ad13cd429ebdc29d1cc02922a80c7489 2023-07-18 10:11:12,871 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testConsecutiveExports/50b83e19e3ce10b35dc481de893da5ae empty. 2023-07-18 10:11:12,871 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testConsecutiveExports/ad13cd429ebdc29d1cc02922a80c7489 empty. 2023-07-18 10:11:12,871 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testConsecutiveExports/50b83e19e3ce10b35dc481de893da5ae 2023-07-18 10:11:12,872 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testConsecutiveExports/ad13cd429ebdc29d1cc02922a80c7489 2023-07-18 10:11:12,872 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-18 10:11:12,893 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-18 10:11:12,895 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 50b83e19e3ce10b35dc481de893da5ae, NAME => 'testtb-testConsecutiveExports,,1689675072861.50b83e19e3ce10b35dc481de893da5ae.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp 2023-07-18 10:11:12,895 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => ad13cd429ebdc29d1cc02922a80c7489, NAME => 'testtb-testConsecutiveExports,1,1689675072861.ad13cd429ebdc29d1cc02922a80c7489.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp 2023-07-18 10:11:12,942 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689675072861.50b83e19e3ce10b35dc481de893da5ae.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:11:12,942 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689675072861.ad13cd429ebdc29d1cc02922a80c7489.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:11:12,944 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 50b83e19e3ce10b35dc481de893da5ae, disabling compactions & flushes 2023-07-18 10:11:12,944 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing ad13cd429ebdc29d1cc02922a80c7489, disabling compactions & flushes 2023-07-18 10:11:12,944 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689675072861.50b83e19e3ce10b35dc481de893da5ae. 2023-07-18 10:11:12,944 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689675072861.ad13cd429ebdc29d1cc02922a80c7489. 2023-07-18 10:11:12,944 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689675072861.50b83e19e3ce10b35dc481de893da5ae. 2023-07-18 10:11:12,944 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689675072861.ad13cd429ebdc29d1cc02922a80c7489. 2023-07-18 10:11:12,944 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689675072861.50b83e19e3ce10b35dc481de893da5ae. after waiting 0 ms 2023-07-18 10:11:12,944 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689675072861.ad13cd429ebdc29d1cc02922a80c7489. after waiting 0 ms 2023-07-18 10:11:12,944 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689675072861.50b83e19e3ce10b35dc481de893da5ae. 2023-07-18 10:11:12,944 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689675072861.ad13cd429ebdc29d1cc02922a80c7489. 2023-07-18 10:11:12,945 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689675072861.50b83e19e3ce10b35dc481de893da5ae. 2023-07-18 10:11:12,945 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689675072861.ad13cd429ebdc29d1cc02922a80c7489. 2023-07-18 10:11:12,945 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 50b83e19e3ce10b35dc481de893da5ae: 2023-07-18 10:11:12,945 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for ad13cd429ebdc29d1cc02922a80c7489: 2023-07-18 10:11:12,948 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 10:11:12,949 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689675072861.50b83e19e3ce10b35dc481de893da5ae.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689675072949"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689675072949"}]},"ts":"1689675072949"} 2023-07-18 10:11:12,949 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689675072861.ad13cd429ebdc29d1cc02922a80c7489.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689675072949"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689675072949"}]},"ts":"1689675072949"} 2023-07-18 10:11:12,952 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-18 10:11:12,954 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 10:11:12,954 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689675072954"}]},"ts":"1689675072954"} 2023-07-18 10:11:12,955 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-18 10:11:12,960 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 10:11:12,961 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 10:11:12,961 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 10:11:12,962 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 10:11:12,962 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 10:11:12,962 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=50b83e19e3ce10b35dc481de893da5ae, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ad13cd429ebdc29d1cc02922a80c7489, ASSIGN}] 2023-07-18 10:11:12,967 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=50b83e19e3ce10b35dc481de893da5ae, ASSIGN 2023-07-18 10:11:12,967 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ad13cd429ebdc29d1cc02922a80c7489, ASSIGN 2023-07-18 10:11:12,968 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=50b83e19e3ce10b35dc481de893da5ae, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33757,1689675027667; forceNewPlan=false, retain=false 2023-07-18 10:11:12,968 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ad13cd429ebdc29d1cc02922a80c7489, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34221,1689675027589; forceNewPlan=false, retain=false 2023-07-18 10:11:12,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-18 10:11:13,118 INFO [jenkins-hbase4:46557] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-18 10:11:13,122 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=50b83e19e3ce10b35dc481de893da5ae, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:13,122 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=ad13cd429ebdc29d1cc02922a80c7489, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:13,122 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689675072861.50b83e19e3ce10b35dc481de893da5ae.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689675073122"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689675073122"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689675073122"}]},"ts":"1689675073122"} 2023-07-18 10:11:13,122 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689675072861.ad13cd429ebdc29d1cc02922a80c7489.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689675073122"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689675073122"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689675073122"}]},"ts":"1689675073122"} 2023-07-18 10:11:13,125 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure 50b83e19e3ce10b35dc481de893da5ae, server=jenkins-hbase4.apache.org,33757,1689675027667}] 2023-07-18 10:11:13,127 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure ad13cd429ebdc29d1cc02922a80c7489, server=jenkins-hbase4.apache.org,34221,1689675027589}] 2023-07-18 10:11:13,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-18 10:11:13,285 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689675072861.50b83e19e3ce10b35dc481de893da5ae. 2023-07-18 10:11:13,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 50b83e19e3ce10b35dc481de893da5ae, NAME => 'testtb-testConsecutiveExports,,1689675072861.50b83e19e3ce10b35dc481de893da5ae.', STARTKEY => '', ENDKEY => '1'} 2023-07-18 10:11:13,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689675072861.50b83e19e3ce10b35dc481de893da5ae. service=AccessControlService 2023-07-18 10:11:13,285 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 10:11:13,285 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689675072861.ad13cd429ebdc29d1cc02922a80c7489. 2023-07-18 10:11:13,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 50b83e19e3ce10b35dc481de893da5ae 2023-07-18 10:11:13,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689675072861.50b83e19e3ce10b35dc481de893da5ae.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:11:13,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ad13cd429ebdc29d1cc02922a80c7489, NAME => 'testtb-testConsecutiveExports,1,1689675072861.ad13cd429ebdc29d1cc02922a80c7489.', STARTKEY => '1', ENDKEY => ''} 2023-07-18 10:11:13,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 50b83e19e3ce10b35dc481de893da5ae 2023-07-18 10:11:13,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 50b83e19e3ce10b35dc481de893da5ae 2023-07-18 10:11:13,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689675072861.ad13cd429ebdc29d1cc02922a80c7489. service=AccessControlService 2023-07-18 10:11:13,286 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 10:11:13,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports ad13cd429ebdc29d1cc02922a80c7489 2023-07-18 10:11:13,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689675072861.ad13cd429ebdc29d1cc02922a80c7489.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:11:13,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ad13cd429ebdc29d1cc02922a80c7489 2023-07-18 10:11:13,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ad13cd429ebdc29d1cc02922a80c7489 2023-07-18 10:11:13,287 INFO [StoreOpener-50b83e19e3ce10b35dc481de893da5ae-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 50b83e19e3ce10b35dc481de893da5ae 2023-07-18 10:11:13,288 INFO [StoreOpener-ad13cd429ebdc29d1cc02922a80c7489-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ad13cd429ebdc29d1cc02922a80c7489 2023-07-18 10:11:13,288 DEBUG [StoreOpener-50b83e19e3ce10b35dc481de893da5ae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testConsecutiveExports/50b83e19e3ce10b35dc481de893da5ae/cf 2023-07-18 10:11:13,288 DEBUG [StoreOpener-50b83e19e3ce10b35dc481de893da5ae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testConsecutiveExports/50b83e19e3ce10b35dc481de893da5ae/cf 2023-07-18 10:11:13,289 INFO [StoreOpener-50b83e19e3ce10b35dc481de893da5ae-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 50b83e19e3ce10b35dc481de893da5ae columnFamilyName cf 2023-07-18 10:11:13,290 INFO [StoreOpener-50b83e19e3ce10b35dc481de893da5ae-1] regionserver.HStore(310): Store=50b83e19e3ce10b35dc481de893da5ae/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 10:11:13,290 DEBUG [StoreOpener-ad13cd429ebdc29d1cc02922a80c7489-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testConsecutiveExports/ad13cd429ebdc29d1cc02922a80c7489/cf 2023-07-18 10:11:13,292 DEBUG [StoreOpener-ad13cd429ebdc29d1cc02922a80c7489-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testConsecutiveExports/ad13cd429ebdc29d1cc02922a80c7489/cf 2023-07-18 10:11:13,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testConsecutiveExports/50b83e19e3ce10b35dc481de893da5ae 2023-07-18 10:11:13,292 INFO [StoreOpener-ad13cd429ebdc29d1cc02922a80c7489-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ad13cd429ebdc29d1cc02922a80c7489 columnFamilyName cf 2023-07-18 10:11:13,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testConsecutiveExports/50b83e19e3ce10b35dc481de893da5ae 2023-07-18 10:11:13,293 INFO [StoreOpener-ad13cd429ebdc29d1cc02922a80c7489-1] regionserver.HStore(310): Store=ad13cd429ebdc29d1cc02922a80c7489/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 10:11:13,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testConsecutiveExports/ad13cd429ebdc29d1cc02922a80c7489 2023-07-18 10:11:13,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testConsecutiveExports/ad13cd429ebdc29d1cc02922a80c7489 2023-07-18 10:11:13,296 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 50b83e19e3ce10b35dc481de893da5ae 2023-07-18 10:11:13,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ad13cd429ebdc29d1cc02922a80c7489 2023-07-18 10:11:13,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testConsecutiveExports/50b83e19e3ce10b35dc481de893da5ae/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 10:11:13,299 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 50b83e19e3ce10b35dc481de893da5ae; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72310016, jitterRate=0.07750320434570312}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 10:11:13,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 50b83e19e3ce10b35dc481de893da5ae: 2023-07-18 10:11:13,300 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689675072861.50b83e19e3ce10b35dc481de893da5ae., pid=45, masterSystemTime=1689675073278 2023-07-18 10:11:13,300 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testConsecutiveExports/ad13cd429ebdc29d1cc02922a80c7489/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 10:11:13,301 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ad13cd429ebdc29d1cc02922a80c7489; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62970045, jitterRate=-0.06167320907115936}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 10:11:13,301 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ad13cd429ebdc29d1cc02922a80c7489: 2023-07-18 10:11:13,302 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689675072861.ad13cd429ebdc29d1cc02922a80c7489., pid=46, masterSystemTime=1689675073281 2023-07-18 10:11:13,302 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689675072861.50b83e19e3ce10b35dc481de893da5ae. 2023-07-18 10:11:13,302 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689675072861.50b83e19e3ce10b35dc481de893da5ae. 2023-07-18 10:11:13,303 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=50b83e19e3ce10b35dc481de893da5ae, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:13,303 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689675072861.50b83e19e3ce10b35dc481de893da5ae.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689675073303"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689675073303"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689675073303"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689675073303"}]},"ts":"1689675073303"} 2023-07-18 10:11:13,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689675072861.ad13cd429ebdc29d1cc02922a80c7489. 2023-07-18 10:11:13,303 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689675072861.ad13cd429ebdc29d1cc02922a80c7489. 2023-07-18 10:11:13,305 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=ad13cd429ebdc29d1cc02922a80c7489, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:13,307 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689675072861.ad13cd429ebdc29d1cc02922a80c7489.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689675073305"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689675073305"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689675073305"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689675073305"}]},"ts":"1689675073305"} 2023-07-18 10:11:13,309 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=43 2023-07-18 10:11:13,309 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure 50b83e19e3ce10b35dc481de893da5ae, server=jenkins-hbase4.apache.org,33757,1689675027667 in 182 msec 2023-07-18 10:11:13,310 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=50b83e19e3ce10b35dc481de893da5ae, ASSIGN in 347 msec 2023-07-18 10:11:13,312 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=44 2023-07-18 10:11:13,312 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure ad13cd429ebdc29d1cc02922a80c7489, server=jenkins-hbase4.apache.org,34221,1689675027589 in 181 msec 2023-07-18 10:11:13,314 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=42 2023-07-18 10:11:13,314 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ad13cd429ebdc29d1cc02922a80c7489, ASSIGN in 350 msec 2023-07-18 10:11:13,314 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 10:11:13,314 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689675073314"}]},"ts":"1689675073314"} 2023-07-18 10:11:13,316 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-18 10:11:13,318 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 10:11:13,319 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-18 10:11:13,321 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34221] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-18 10:11:13,322 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:11:13,322 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:11:13,322 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:11:13,322 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:11:13,324 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-18 10:11:13,324 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-18 10:11:13,324 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-18 10:11:13,324 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-18 10:11:13,325 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 461 msec 2023-07-18 10:11:13,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-18 10:11:13,472 INFO [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-18 10:11:13,472 DEBUG [Listener at jenkins-hbase4.apache.org/42677] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testConsecutiveExports get assigned. Timeout = 60000ms 2023-07-18 10:11:13,473 INFO [Listener at jenkins-hbase4.apache.org/42677] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 10:11:13,477 INFO [Listener at jenkins-hbase4.apache.org/42677] hbase.HBaseTestingUtility(3484): All regions for table testtb-testConsecutiveExports assigned to meta. Checking AM states. 2023-07-18 10:11:13,477 INFO [Listener at jenkins-hbase4.apache.org/42677] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 10:11:13,477 INFO [Listener at jenkins-hbase4.apache.org/42677] hbase.HBaseTestingUtility(3504): All regions for table testtb-testConsecutiveExports assigned. 2023-07-18 10:11:13,481 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-18 10:11:13,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689675073481 (current time:1689675073481). 2023-07-18 10:11:13,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 10:11:13,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] zookeeper.ReadOnlyZKClient(139): Connect 0x3f7780a8 to 127.0.0.1:56089 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 10:11:13,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@44f7f779, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 10:11:13,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:11:13,499 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46876, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:11:13,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3f7780a8 to 127.0.0.1:56089 2023-07-18 10:11:13,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 10:11:13,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] zookeeper.ReadOnlyZKClient(139): Connect 0x4c1cb6cd to 127.0.0.1:56089 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 10:11:13,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4fed1d26, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 10:11:13,613 DEBUG [hconnection-0x34da679d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:11:13,617 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46892, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:11:13,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:11:13,625 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35462, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:11:13,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4c1cb6cd to 127.0.0.1:56089 2023-07-18 10:11:13,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 10:11:13,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-18 10:11:13,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 10:11:13,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-18 10:11:13,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-18 10:11:13,632 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-18 10:11:13,633 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689675673633 2023-07-18 10:11:13,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-18 10:11:13,633 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-18 10:11:13,634 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 10:11:13,634 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 10:11:13,639 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-18 10:11:13,640 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-18 10:11:13,642 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 11 msec 2023-07-18 10:11:13,643 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-18 10:11:13,643 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689675673643 2023-07-18 10:11:13,658 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,658 INFO [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-18 10:11:13,658 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:11:13,659 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-18 10:11:13,659 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-18 10:11:13,660 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,660 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,666 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:11:13,666 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:11:13,666 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:11:13,666 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:11:13,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:11:13,666 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:13,666 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:11:13,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:11:13,666 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:11:13,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:11:13,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,667 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:13,667 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:13,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,667 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,667 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:13,667 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 10:11:13,667 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-18 10:11:13,667 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-18 10:11:13,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,668 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-18 10:11:13,668 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-18 10:11:13,668 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,668 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,668 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-18 10:11:13,668 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-18 10:11:13,668 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:11:13,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-18 10:11:13,670 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-18 10:11:13,670 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-18 10:11:13,670 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40089,1689675027524' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-18 10:11:13,668 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:11:13,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,671 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-18 10:11:13,671 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-18 10:11:13,671 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-18 10:11:13,671 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34221,1689675027589' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-18 10:11:13,671 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,671 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-18 10:11:13,671 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:11:13,674 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-18 10:11:13,674 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-18 10:11:13,674 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33757,1689675027667' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-18 10:11:13,674 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,676 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,676 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:13,676 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:13,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:11:13,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:11:13,676 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:11:13,677 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:13,677 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,677 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,677 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:11:13,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:11:13,677 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,677 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:11:13,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:11:13,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:13,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:13,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:13,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:11:13,679 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34221,1689675027589' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-18 10:11:13,680 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@21148a15[Count = 1] remaining members to acquire global barrier 2023-07-18 10:11:13,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:13,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:11:13,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:11:13,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:11:13,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:11:13,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:13,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:13,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:13,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:11:13,682 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33757,1689675027667' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-18 10:11:13,682 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@21148a15[Count = 0] remaining members to acquire global barrier 2023-07-18 10:11:13,682 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-18 10:11:13,682 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,685 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,685 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,685 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,685 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-18 10:11:13,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,686 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-18 10:11:13,686 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 10:11:13,686 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 10:11:13,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,686 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 10:11:13,686 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-18 10:11:13,686 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-18 10:11:13,686 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689675072861.ad13cd429ebdc29d1cc02922a80c7489. 2023-07-18 10:11:13,685 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:13,686 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,40089,1689675027524' in zk 2023-07-18 10:11:13,686 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 10:11:13,686 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689675072861.50b83e19e3ce10b35dc481de893da5ae. 2023-07-18 10:11:13,686 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689675072861.ad13cd429ebdc29d1cc02922a80c7489. started... 2023-07-18 10:11:13,686 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689675072861.50b83e19e3ce10b35dc481de893da5ae. started... 2023-07-18 10:11:13,686 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:13,686 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 10:11:13,688 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 50b83e19e3ce10b35dc481de893da5ae: 2023-07-18 10:11:13,688 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ad13cd429ebdc29d1cc02922a80c7489: 2023-07-18 10:11:13,688 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689675072861.ad13cd429ebdc29d1cc02922a80c7489.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,688 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689675072861.50b83e19e3ce10b35dc481de893da5ae.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,688 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 10:11:13,689 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 10:11:13,689 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 10:11:13,689 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 10:11:13,691 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-18 10:11:13,691 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:11:13,691 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-18 10:11:13,735 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 10:11:13,735 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689675072861.50b83e19e3ce10b35dc481de893da5ae. completed. 2023-07-18 10:11:13,735 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689675072861.50b83e19e3ce10b35dc481de893da5ae. 2023-07-18 10:11:13,736 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 10:11:13,736 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 10:11:13,736 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:13,736 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-18 10:11:13,736 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,33757,1689675027667' in zk 2023-07-18 10:11:13,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-18 10:11:13,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-18 10:11:13,737 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 10:11:13,737 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689675072861.ad13cd429ebdc29d1cc02922a80c7489. completed. 2023-07-18 10:11:13,737 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689675072861.ad13cd429ebdc29d1cc02922a80c7489. 2023-07-18 10:11:13,738 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 10:11:13,738 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 10:11:13,738 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:13,738 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-18 10:11:13,738 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,34221,1689675027589' in zk 2023-07-18 10:11:13,738 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:13,738 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-18 10:11:13,738 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:11:13,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:13,738 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-18 10:11:13,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:11:13,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:11:13,742 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:13,742 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-18 10:11:13,742 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:11:13,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:11:13,742 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-18 10:11:13,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:11:13,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:13,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:13,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:13,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:11:13,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:13,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:13,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:13,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,33757,1689675027667': 2023-07-18 10:11:13,746 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33757,1689675027667' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-18 10:11:13,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:13,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:11:13,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:11:13,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:11:13,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:11:13,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:13,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:13,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:13,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:11:13,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:13,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:13,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:13,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,34221,1689675027589': 2023-07-18 10:11:13,750 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34221,1689675027589' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-18 10:11:13,750 INFO [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-18 10:11:13,750 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 10:11:13,750 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 10:11:13,750 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,750 INFO [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 10:11:13,752 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,752 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,753 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:11:13,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:11:13,753 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:11:13,753 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:11:13,752 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,753 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:11:13,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:11:13,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:11:13,754 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:13,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:11:13,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:11:13,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:11:13,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:11:13,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:11:13,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:11:13,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,754 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:13,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:13,756 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:13,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:13,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:13,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:11:13,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:13,758 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:13,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:13,758 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:13,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:13,759 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:13,762 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:13,762 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:11:13,762 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:11:13,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:11:13,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:11:13,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:11:13,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:11:13,762 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,762 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:13,762 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:13,762 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,762 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:13,763 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,763 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:13,763 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:13,763 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,763 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,763 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:11:13,762 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:11:13,763 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,762 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:11:13,762 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:11:13,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:11:13,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:11:13,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:11:13,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:11:13,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:11:13,763 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:11:13,763 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:11:13,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:11:13,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:11:13,767 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,819 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,855 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-18 10:11:13,855 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,856 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,856 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689675073633Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689675073763 (+130 ms)Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689675073763Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689675073771 (+8 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689675073809 (+38 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689675073855 (+46 ms) 2023-07-18 10:11:13,859 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-18 10:11:13,862 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 225 msec 2023-07-18 10:11:13,937 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 10:11:13,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-18 10:11:13,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 10:11:13,948 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33757] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689675072861.50b83e19e3ce10b35dc481de893da5ae. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 10:11:13,953 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34221] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689675072861.ad13cd429ebdc29d1cc02922a80c7489. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 10:11:13,956 DEBUG [Listener at jenkins-hbase4.apache.org/42677] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-18 10:11:13,956 DEBUG [Listener at jenkins-hbase4.apache.org/42677] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689675072861.50b83e19e3ce10b35dc481de893da5ae. 2023-07-18 10:11:13,956 INFO [Listener at jenkins-hbase4.apache.org/42677] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 10:11:13,967 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-18 10:11:13,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689675073967 (current time:1689675073967). 2023-07-18 10:11:13,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 10:11:13,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] zookeeper.ReadOnlyZKClient(139): Connect 0x6829c995 to 127.0.0.1:56089 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 10:11:13,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6ea5db2d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 10:11:13,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:11:13,984 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46900, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:11:13,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6829c995 to 127.0.0.1:56089 2023-07-18 10:11:13,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 10:11:13,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] zookeeper.ReadOnlyZKClient(139): Connect 0x023bd029 to 127.0.0.1:56089 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 10:11:13,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@24f8d49a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 10:11:13,994 DEBUG [hconnection-0x64440f9b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:11:13,998 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46914, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:11:14,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:11:14,005 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35468, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:11:14,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x023bd029 to 127.0.0.1:56089 2023-07-18 10:11:14,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 10:11:14,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-18 10:11:14,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 10:11:14,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-18 10:11:14,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-18 10:11:14,011 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-18 10:11:14,012 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689675674012 2023-07-18 10:11:14,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-18 10:11:14,012 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-18 10:11:14,013 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 10:11:14,013 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 10:11:14,016 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-18 10:11:14,017 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-18 10:11:14,019 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 10 msec 2023-07-18 10:11:14,020 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-18 10:11:14,023 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689675674023 2023-07-18 10:11:14,038 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-18 10:11:14,038 INFO [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-18 10:11:14,038 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:11:14,040 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-18 10:11:14,040 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-18 10:11:14,040 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 10:11:14,040 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-18 10:11:14,042 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:14,042 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:11:14,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:11:14,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:11:14,042 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:11:14,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:11:14,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:11:14,043 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:14,042 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:11:14,043 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:14,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:11:14,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:11:14,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-18 10:11:14,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-18 10:11:14,044 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:14,044 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 10:11:14,044 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 10:11:14,044 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 10:11:14,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-18 10:11:14,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-18 10:11:14,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-18 10:11:14,044 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 10:11:14,044 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-18 10:11:14,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-18 10:11:14,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-18 10:11:14,045 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-18 10:11:14,045 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-18 10:11:14,045 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-18 10:11:14,045 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:11:14,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-18 10:11:14,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-18 10:11:14,045 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-18 10:11:14,047 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-18 10:11:14,047 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-18 10:11:14,047 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:11:14,047 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-18 10:11:14,049 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34221,1689675027589' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-18 10:11:14,047 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-18 10:11:14,049 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-18 10:11:14,049 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-18 10:11:14,049 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33757,1689675027667' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-18 10:11:14,050 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-18 10:11:14,051 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-18 10:11:14,051 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:11:14,051 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:14,051 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 10:11:14,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:14,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:11:14,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:11:14,053 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 10:11:14,053 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:14,053 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 10:11:14,053 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:11:14,053 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-18 10:11:14,053 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-18 10:11:14,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:11:14,053 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40089,1689675027524' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-18 10:11:14,053 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 10:11:14,053 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:11:14,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:11:14,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-18 10:11:14,055 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 10:11:14,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:14,055 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 10:11:14,055 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:11:14,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:14,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:14,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:11:14,057 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34221,1689675027589' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-18 10:11:14,057 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3bbcb7ff[Count = 1] remaining members to acquire global barrier 2023-07-18 10:11:14,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:14,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:11:14,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:11:14,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:11:14,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:11:14,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-18 10:11:14,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:14,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:14,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:14,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:11:14,066 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33757,1689675027667' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-18 10:11:14,066 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3bbcb7ff[Count = 0] remaining members to acquire global barrier 2023-07-18 10:11:14,067 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-18 10:11:14,067 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 10:11:14,068 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 10:11:14,068 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 10:11:14,068 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 10:11:14,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 10:11:14,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 10:11:14,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 10:11:14,069 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:14,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 10:11:14,069 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-18 10:11:14,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 10:11:14,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 10:11:14,069 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-18 10:11:14,069 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-18 10:11:14,069 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-18 10:11:14,069 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689675072861.ad13cd429ebdc29d1cc02922a80c7489. 2023-07-18 10:11:14,069 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 10:11:14,069 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 10:11:14,069 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689675072861.ad13cd429ebdc29d1cc02922a80c7489. started... 2023-07-18 10:11:14,069 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,40089,1689675027524' in zk 2023-07-18 10:11:14,069 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689675072861.50b83e19e3ce10b35dc481de893da5ae. 2023-07-18 10:11:14,069 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:14,070 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 10:11:14,069 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 10:11:14,070 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 10:11:14,070 INFO [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ad13cd429ebdc29d1cc02922a80c7489 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-18 10:11:14,075 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689675072861.50b83e19e3ce10b35dc481de893da5ae. started... 2023-07-18 10:11:14,075 INFO [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 50b83e19e3ce10b35dc481de893da5ae 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-18 10:11:14,078 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-18 10:11:14,078 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:11:14,078 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-18 10:11:14,107 INFO [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testConsecutiveExports/ad13cd429ebdc29d1cc02922a80c7489/.tmp/cf/baa0c146931940c6a00f90191aef43d9 2023-07-18 10:11:14,111 INFO [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testConsecutiveExports/50b83e19e3ce10b35dc481de893da5ae/.tmp/cf/25ef49150da24575b7c7c907afefa97a 2023-07-18 10:11:14,114 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 10:11:14,114 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testConsecutiveExports/ad13cd429ebdc29d1cc02922a80c7489/.tmp/cf/baa0c146931940c6a00f90191aef43d9 as hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testConsecutiveExports/ad13cd429ebdc29d1cc02922a80c7489/cf/baa0c146931940c6a00f90191aef43d9 2023-07-18 10:11:14,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-18 10:11:14,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-18 10:11:14,117 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 10:11:14,121 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testConsecutiveExports/50b83e19e3ce10b35dc481de893da5ae/.tmp/cf/25ef49150da24575b7c7c907afefa97a as hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testConsecutiveExports/50b83e19e3ce10b35dc481de893da5ae/cf/25ef49150da24575b7c7c907afefa97a 2023-07-18 10:11:14,127 INFO [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testConsecutiveExports/ad13cd429ebdc29d1cc02922a80c7489/cf/baa0c146931940c6a00f90191aef43d9, entries=47, sequenceid=6, filesize=8.0 K 2023-07-18 10:11:14,128 INFO [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testConsecutiveExports/50b83e19e3ce10b35dc481de893da5ae/cf/25ef49150da24575b7c7c907afefa97a, entries=3, sequenceid=6, filesize=5.0 K 2023-07-18 10:11:14,128 INFO [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for ad13cd429ebdc29d1cc02922a80c7489 in 58ms, sequenceid=6, compaction requested=false 2023-07-18 10:11:14,138 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-18 10:11:14,139 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ad13cd429ebdc29d1cc02922a80c7489: 2023-07-18 10:11:14,139 INFO [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 50b83e19e3ce10b35dc481de893da5ae in 64ms, sequenceid=6, compaction requested=false 2023-07-18 10:11:14,139 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689675072861.ad13cd429ebdc29d1cc02922a80c7489.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-18 10:11:14,141 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 50b83e19e3ce10b35dc481de893da5ae: 2023-07-18 10:11:14,141 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 10:11:14,141 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testConsecutiveExports/ad13cd429ebdc29d1cc02922a80c7489/cf/baa0c146931940c6a00f90191aef43d9] hfiles 2023-07-18 10:11:14,141 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689675072861.50b83e19e3ce10b35dc481de893da5ae.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-18 10:11:14,141 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testConsecutiveExports/ad13cd429ebdc29d1cc02922a80c7489/cf/baa0c146931940c6a00f90191aef43d9 for snapshot=snaptb0-testConsecutiveExports 2023-07-18 10:11:14,141 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 10:11:14,141 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testConsecutiveExports/50b83e19e3ce10b35dc481de893da5ae/cf/25ef49150da24575b7c7c907afefa97a] hfiles 2023-07-18 10:11:14,141 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testConsecutiveExports/50b83e19e3ce10b35dc481de893da5ae/cf/25ef49150da24575b7c7c907afefa97a for snapshot=snaptb0-testConsecutiveExports 2023-07-18 10:11:14,154 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689675072861.50b83e19e3ce10b35dc481de893da5ae. completed. 2023-07-18 10:11:14,154 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689675072861.50b83e19e3ce10b35dc481de893da5ae. 2023-07-18 10:11:14,154 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 10:11:14,154 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 10:11:14,154 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:14,154 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-18 10:11:14,154 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,33757,1689675027667' in zk 2023-07-18 10:11:14,155 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689675072861.ad13cd429ebdc29d1cc02922a80c7489. completed. 2023-07-18 10:11:14,155 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689675072861.ad13cd429ebdc29d1cc02922a80c7489. 2023-07-18 10:11:14,155 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 10:11:14,155 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 10:11:14,155 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:14,155 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-18 10:11:14,155 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,34221,1689675027589' in zk 2023-07-18 10:11:14,156 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:14,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:14,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:11:14,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:11:14,158 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:14,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:11:14,158 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-18 10:11:14,158 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:11:14,158 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-18 10:11:14,160 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-18 10:11:14,160 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:11:14,160 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-18 10:11:14,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:11:14,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-18 10:11:14,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:14,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:14,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:14,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:11:14,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-18 10:11:14,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:14,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:14,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:14,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,33757,1689675027667': 2023-07-18 10:11:14,166 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33757,1689675027667' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-18 10:11:14,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:14,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:11:14,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:11:14,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:11:14,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:11:14,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-18 10:11:14,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:14,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:14,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:14,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:11:14,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-18 10:11:14,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:14,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:14,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:14,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,34221,1689675027589': 2023-07-18 10:11:14,171 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34221,1689675027589' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-18 10:11:14,171 INFO [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-18 10:11:14,171 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 10:11:14,171 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 10:11:14,171 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-18 10:11:14,171 INFO [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 10:11:14,173 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 10:11:14,173 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 10:11:14,173 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 10:11:14,173 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 10:11:14,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 10:11:14,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 10:11:14,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 10:11:14,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 10:11:14,173 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 10:11:14,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 10:11:14,174 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:11:14,173 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:11:14,173 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:11:14,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 10:11:14,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:11:14,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:11:14,175 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:14,175 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:11:14,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:11:14,175 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:11:14,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:11:14,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 10:11:14,176 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:14,177 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:14,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:11:14,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:11:14,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:11:14,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 10:11:14,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 10:11:14,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-18 10:11:14,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:11:14,179 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:14,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-18 10:11:14,180 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:14,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:14,180 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:14,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:14,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:14,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:11:14,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-18 10:11:14,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:14,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:14,188 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:14,188 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:11:14,188 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-18 10:11:14,189 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:11:14,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:11:14,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:11:14,189 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:11:14,189 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:14,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:11:14,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:11:14,189 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:14,189 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:11:14,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:11:14,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:14,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:11:14,189 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-18 10:11:14,189 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:14,189 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 10:11:14,189 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:14,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:11:14,189 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:14,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:11:14,190 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 10:11:14,190 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 10:11:14,190 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:11:14,190 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-18 10:11:14,192 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-18 10:11:14,192 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:11:14,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:11:14,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:11:14,192 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports because node does not exist (not an error) 2023-07-18 10:11:14,193 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-18 10:11:14,194 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:11:14,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:11:14,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:11:14,225 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-18 10:11:14,260 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-18 10:11:14,260 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-18 10:11:14,261 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-18 10:11:14,261 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689675074012Consolidate snapshot: snaptb0-testConsecutiveExports at 1689675074192 (+180 ms)Loading Region manifests for snaptb0-testConsecutiveExports at 1689675074192Writing data manifest for snaptb0-testConsecutiveExports at 1689675074196 (+4 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689675074216 (+20 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689675074260 (+44 ms) 2023-07-18 10:11:14,264 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-18 10:11:14,266 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 251 msec 2023-07-18 10:11:14,319 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 10:11:14,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-18 10:11:14,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 10:11:14,322 INFO [Listener at jenkins-hbase4.apache.org/42677] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/local-export-1689675074322 2023-07-18 10:11:14,323 INFO [Listener at jenkins-hbase4.apache.org/42677] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/local-export-1689675074322, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/local-export-1689675074322, srcFsUri=hdfs://localhost:35953, srcDir=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336 2023-07-18 10:11:14,352 DEBUG [Listener at jenkins-hbase4.apache.org/42677] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35953, inputRoot=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336 2023-07-18 10:11:14,352 DEBUG [Listener at jenkins-hbase4.apache.org/42677] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@7ba1c95a, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/local-export-1689675074322, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/local-export-1689675074322/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-18 10:11:14,352 INFO [Listener at jenkins-hbase4.apache.org/42677] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35953, inputRoot=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336, snapshotDir=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-18 10:11:14,361 INFO [Listener at jenkins-hbase4.apache.org/42677] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/local-export-1689675074322/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-18 10:11:14,375 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:14,375 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:14,376 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:14,376 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:14,377 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:14,377 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:14,378 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:14,456 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/hadoop-8892114737471572.jar 2023-07-18 10:11:14,457 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:14,457 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:14,457 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:14,458 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:14,458 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:14,458 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:14,459 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-18 10:11:14,459 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-18 10:11:14,460 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-18 10:11:14,460 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-18 10:11:14,461 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-18 10:11:14,461 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-18 10:11:14,462 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-18 10:11:14,462 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-18 10:11:14,462 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-18 10:11:14,463 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-18 10:11:14,463 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 10:11:14,464 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 10:11:14,464 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 10:11:14,464 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 10:11:14,464 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 10:11:14,465 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 10:11:14,465 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 10:11:14,867 WARN [Listener at jenkins-hbase4.apache.org/42677] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-18 10:11:14,869 INFO [Listener at jenkins-hbase4.apache.org/42677] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-18 10:11:14,871 DEBUG [Listener at jenkins-hbase4.apache.org/42677] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-18 10:11:17,455 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 10:11:17,457 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 10:11:17,459 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689675035639_0002_000001 (auth:SIMPLE) 2023-07-18 10:11:18,132 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-18 10:11:18,428 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689675035639_0003_000001 (auth:SIMPLE) 2023-07-18 10:11:23,065 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689675035639_0003_000001 (auth:SIMPLE) 2023-07-18 10:11:25,303 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689675035639_0003_000001 (auth:SIMPLE) 2023-07-18 10:11:28,066 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689675035639_0003_000001 (auth:SIMPLE) 2023-07-18 10:11:30,081 INFO [Listener at jenkins-hbase4.apache.org/42677] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-18 10:11:30,081 INFO [Listener at jenkins-hbase4.apache.org/42677] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-18 10:11:30,084 INFO [Listener at jenkins-hbase4.apache.org/42677] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-18 10:11:30,084 INFO [Listener at jenkins-hbase4.apache.org/42677] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-18 10:11:30,085 INFO [Listener at jenkins-hbase4.apache.org/42677] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-18 10:11:30,085 DEBUG [Listener at jenkins-hbase4.apache.org/42677] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1314676217_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-18 10:11:30,088 DEBUG [Listener at jenkins-hbase4.apache.org/42677] snapshot.TestExportSnapshot(367): hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-18 10:11:30,088 DEBUG [Listener at jenkins-hbase4.apache.org/42677] snapshot.TestExportSnapshot(367): hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-18 10:11:30,088 DEBUG [Listener at jenkins-hbase4.apache.org/42677] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@9381970 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/local-export-1689675074322/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/local-export-1689675074322/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-18 10:11:30,089 DEBUG [Listener at jenkins-hbase4.apache.org/42677] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/local-export-1689675074322/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-18 10:11:30,089 DEBUG [Listener at jenkins-hbase4.apache.org/42677] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/local-export-1689675074322/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-18 10:11:30,090 INFO [Listener at jenkins-hbase4.apache.org/42677] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/local-export-1689675074322, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/local-export-1689675074322, srcFsUri=hdfs://localhost:35953, srcDir=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336 2023-07-18 10:11:30,111 DEBUG [Listener at jenkins-hbase4.apache.org/42677] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35953, inputRoot=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336 2023-07-18 10:11:30,111 DEBUG [Listener at jenkins-hbase4.apache.org/42677] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@47c4edac, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/local-export-1689675074322, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/local-export-1689675074322/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-18 10:11:30,111 INFO [Listener at jenkins-hbase4.apache.org/42677] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35953, inputRoot=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336, snapshotDir=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-18 10:11:30,122 INFO [Listener at jenkins-hbase4.apache.org/42677] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/local-export-1689675074322/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-18 10:11:30,133 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:30,134 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:30,134 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:30,134 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:30,135 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:30,135 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:30,135 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:30,204 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/hadoop-4465429954170428015.jar 2023-07-18 10:11:30,204 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:30,205 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:30,205 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:30,205 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:30,206 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:30,206 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:30,206 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-18 10:11:30,207 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-18 10:11:30,207 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-18 10:11:30,207 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-18 10:11:30,208 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-18 10:11:30,208 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-18 10:11:30,208 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-18 10:11:30,209 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-18 10:11:30,209 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-18 10:11:30,209 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-18 10:11:30,210 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 10:11:30,210 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 10:11:30,211 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 10:11:30,211 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 10:11:30,211 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 10:11:30,211 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 10:11:30,212 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 10:11:30,589 WARN [Listener at jenkins-hbase4.apache.org/42677] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-18 10:11:30,591 INFO [Listener at jenkins-hbase4.apache.org/42677] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-18 10:11:30,593 DEBUG [Listener at jenkins-hbase4.apache.org/42677] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-18 10:11:34,243 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 10:11:34,244 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 10:11:34,248 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689675035639_0003_000001 (auth:SIMPLE) 2023-07-18 10:11:34,471 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689675035639_0004_000001 (auth:SIMPLE) 2023-07-18 10:11:39,215 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689675035639_0004_000001 (auth:SIMPLE) 2023-07-18 10:11:41,541 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689675035639_0004_000001 (auth:SIMPLE) 2023-07-18 10:11:45,865 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689675035639_0004_000001 (auth:SIMPLE) 2023-07-18 10:11:47,799 INFO [Listener at jenkins-hbase4.apache.org/42677] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-18 10:11:47,800 INFO [Listener at jenkins-hbase4.apache.org/42677] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-18 10:11:47,803 INFO [Listener at jenkins-hbase4.apache.org/42677] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-18 10:11:47,804 INFO [Listener at jenkins-hbase4.apache.org/42677] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-18 10:11:47,804 INFO [Listener at jenkins-hbase4.apache.org/42677] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-18 10:11:47,804 DEBUG [Listener at jenkins-hbase4.apache.org/42677] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1314676217_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-18 10:11:47,807 DEBUG [Listener at jenkins-hbase4.apache.org/42677] snapshot.TestExportSnapshot(367): hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-18 10:11:47,807 DEBUG [Listener at jenkins-hbase4.apache.org/42677] snapshot.TestExportSnapshot(367): hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-18 10:11:47,807 DEBUG [Listener at jenkins-hbase4.apache.org/42677] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@9381970 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/local-export-1689675074322/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/local-export-1689675074322/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-18 10:11:47,807 DEBUG [Listener at jenkins-hbase4.apache.org/42677] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/local-export-1689675074322/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-18 10:11:47,808 DEBUG [Listener at jenkins-hbase4.apache.org/42677] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/local-export-1689675074322/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-18 10:11:47,820 INFO [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-18 10:11:47,820 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-18 10:11:47,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-18 10:11:47,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-18 10:11:47,828 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689675107827"}]},"ts":"1689675107827"} 2023-07-18 10:11:47,829 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-18 10:11:47,833 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-18 10:11:47,835 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=50b83e19e3ce10b35dc481de893da5ae, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ad13cd429ebdc29d1cc02922a80c7489, UNASSIGN}] 2023-07-18 10:11:47,838 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ad13cd429ebdc29d1cc02922a80c7489, UNASSIGN 2023-07-18 10:11:47,839 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=50b83e19e3ce10b35dc481de893da5ae, UNASSIGN 2023-07-18 10:11:47,841 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=ad13cd429ebdc29d1cc02922a80c7489, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:47,841 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=50b83e19e3ce10b35dc481de893da5ae, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:47,841 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689675072861.ad13cd429ebdc29d1cc02922a80c7489.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689675107840"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689675107840"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689675107840"}]},"ts":"1689675107840"} 2023-07-18 10:11:47,841 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689675072861.50b83e19e3ce10b35dc481de893da5ae.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689675107840"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689675107840"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689675107840"}]},"ts":"1689675107840"} 2023-07-18 10:11:47,842 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure ad13cd429ebdc29d1cc02922a80c7489, server=jenkins-hbase4.apache.org,34221,1689675027589}] 2023-07-18 10:11:47,844 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure 50b83e19e3ce10b35dc481de893da5ae, server=jenkins-hbase4.apache.org,33757,1689675027667}] 2023-07-18 10:11:47,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-18 10:11:47,996 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ad13cd429ebdc29d1cc02922a80c7489 2023-07-18 10:11:47,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ad13cd429ebdc29d1cc02922a80c7489, disabling compactions & flushes 2023-07-18 10:11:47,996 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689675072861.ad13cd429ebdc29d1cc02922a80c7489. 2023-07-18 10:11:47,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689675072861.ad13cd429ebdc29d1cc02922a80c7489. 2023-07-18 10:11:47,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689675072861.ad13cd429ebdc29d1cc02922a80c7489. after waiting 0 ms 2023-07-18 10:11:47,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689675072861.ad13cd429ebdc29d1cc02922a80c7489. 2023-07-18 10:11:47,997 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 50b83e19e3ce10b35dc481de893da5ae 2023-07-18 10:11:47,997 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 50b83e19e3ce10b35dc481de893da5ae, disabling compactions & flushes 2023-07-18 10:11:47,997 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689675072861.50b83e19e3ce10b35dc481de893da5ae. 2023-07-18 10:11:47,997 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689675072861.50b83e19e3ce10b35dc481de893da5ae. 2023-07-18 10:11:47,997 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689675072861.50b83e19e3ce10b35dc481de893da5ae. after waiting 0 ms 2023-07-18 10:11:47,997 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689675072861.50b83e19e3ce10b35dc481de893da5ae. 2023-07-18 10:11:48,014 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testConsecutiveExports/50b83e19e3ce10b35dc481de893da5ae/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 10:11:48,014 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testConsecutiveExports/ad13cd429ebdc29d1cc02922a80c7489/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 10:11:48,014 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 10:11:48,014 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 10:11:48,015 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689675072861.50b83e19e3ce10b35dc481de893da5ae. 2023-07-18 10:11:48,016 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 50b83e19e3ce10b35dc481de893da5ae: 2023-07-18 10:11:48,016 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689675072861.ad13cd429ebdc29d1cc02922a80c7489. 2023-07-18 10:11:48,016 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ad13cd429ebdc29d1cc02922a80c7489: 2023-07-18 10:11:48,018 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 50b83e19e3ce10b35dc481de893da5ae 2023-07-18 10:11:48,019 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=50b83e19e3ce10b35dc481de893da5ae, regionState=CLOSED 2023-07-18 10:11:48,019 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689675072861.50b83e19e3ce10b35dc481de893da5ae.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689675108019"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689675108019"}]},"ts":"1689675108019"} 2023-07-18 10:11:48,019 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ad13cd429ebdc29d1cc02922a80c7489 2023-07-18 10:11:48,020 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=ad13cd429ebdc29d1cc02922a80c7489, regionState=CLOSED 2023-07-18 10:11:48,020 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689675072861.ad13cd429ebdc29d1cc02922a80c7489.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689675108020"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689675108020"}]},"ts":"1689675108020"} 2023-07-18 10:11:48,023 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=52 2023-07-18 10:11:48,023 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure 50b83e19e3ce10b35dc481de893da5ae, server=jenkins-hbase4.apache.org,33757,1689675027667 in 177 msec 2023-07-18 10:11:48,024 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=53 2023-07-18 10:11:48,024 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure ad13cd429ebdc29d1cc02922a80c7489, server=jenkins-hbase4.apache.org,34221,1689675027589 in 180 msec 2023-07-18 10:11:48,024 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=50b83e19e3ce10b35dc481de893da5ae, UNASSIGN in 188 msec 2023-07-18 10:11:48,025 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-07-18 10:11:48,025 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ad13cd429ebdc29d1cc02922a80c7489, UNASSIGN in 189 msec 2023-07-18 10:11:48,026 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689675108026"}]},"ts":"1689675108026"} 2023-07-18 10:11:48,027 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-18 10:11:48,029 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-18 10:11:48,031 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 208 msec 2023-07-18 10:11:48,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-18 10:11:48,130 INFO [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-18 10:11:48,130 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-18 10:11:48,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-18 10:11:48,134 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-18 10:11:48,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-18 10:11:48,135 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-18 10:11:48,137 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34221] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-18 10:11:48,140 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-18 10:11:48,140 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-18 10:11:48,140 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-18 10:11:48,140 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-18 10:11:48,141 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-18 10:11:48,141 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-18 10:11:48,141 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-18 10:11:48,141 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-18 10:11:48,141 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testConsecutiveExports/50b83e19e3ce10b35dc481de893da5ae 2023-07-18 10:11:48,141 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testConsecutiveExports/ad13cd429ebdc29d1cc02922a80c7489 2023-07-18 10:11:48,144 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-18 10:11:48,144 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-18 10:11:48,144 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:11:48,144 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testConsecutiveExports/ad13cd429ebdc29d1cc02922a80c7489/cf, FileablePath, hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testConsecutiveExports/ad13cd429ebdc29d1cc02922a80c7489/recovered.edits] 2023-07-18 10:11:48,144 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-18 10:11:48,144 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-18 10:11:48,144 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:11:48,144 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:11:48,144 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testConsecutiveExports/50b83e19e3ce10b35dc481de893da5ae/cf, FileablePath, hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testConsecutiveExports/50b83e19e3ce10b35dc481de893da5ae/recovered.edits] 2023-07-18 10:11:48,144 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:11:48,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-18 10:11:48,154 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testConsecutiveExports/ad13cd429ebdc29d1cc02922a80c7489/cf/baa0c146931940c6a00f90191aef43d9 to hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/archive/data/default/testtb-testConsecutiveExports/ad13cd429ebdc29d1cc02922a80c7489/cf/baa0c146931940c6a00f90191aef43d9 2023-07-18 10:11:48,155 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testConsecutiveExports/50b83e19e3ce10b35dc481de893da5ae/cf/25ef49150da24575b7c7c907afefa97a to hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/archive/data/default/testtb-testConsecutiveExports/50b83e19e3ce10b35dc481de893da5ae/cf/25ef49150da24575b7c7c907afefa97a 2023-07-18 10:11:48,158 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testConsecutiveExports/ad13cd429ebdc29d1cc02922a80c7489/recovered.edits/9.seqid to hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/archive/data/default/testtb-testConsecutiveExports/ad13cd429ebdc29d1cc02922a80c7489/recovered.edits/9.seqid 2023-07-18 10:11:48,158 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testConsecutiveExports/50b83e19e3ce10b35dc481de893da5ae/recovered.edits/9.seqid to hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/archive/data/default/testtb-testConsecutiveExports/50b83e19e3ce10b35dc481de893da5ae/recovered.edits/9.seqid 2023-07-18 10:11:48,158 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testConsecutiveExports/ad13cd429ebdc29d1cc02922a80c7489 2023-07-18 10:11:48,159 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testConsecutiveExports/50b83e19e3ce10b35dc481de893da5ae 2023-07-18 10:11:48,159 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-18 10:11:48,164 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-18 10:11:48,171 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-18 10:11:48,173 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-18 10:11:48,174 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-18 10:11:48,174 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-18 10:11:48,174 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689675072861.50b83e19e3ce10b35dc481de893da5ae.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689675108174"}]},"ts":"9223372036854775807"} 2023-07-18 10:11:48,174 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689675072861.ad13cd429ebdc29d1cc02922a80c7489.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689675108174"}]},"ts":"9223372036854775807"} 2023-07-18 10:11:48,176 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-18 10:11:48,176 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 50b83e19e3ce10b35dc481de893da5ae, NAME => 'testtb-testConsecutiveExports,,1689675072861.50b83e19e3ce10b35dc481de893da5ae.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => ad13cd429ebdc29d1cc02922a80c7489, NAME => 'testtb-testConsecutiveExports,1,1689675072861.ad13cd429ebdc29d1cc02922a80c7489.', STARTKEY => '1', ENDKEY => ''}] 2023-07-18 10:11:48,176 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-18 10:11:48,176 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689675108176"}]},"ts":"9223372036854775807"} 2023-07-18 10:11:48,178 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-18 10:11:48,180 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-18 10:11:48,181 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 50 msec 2023-07-18 10:11:48,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-18 10:11:48,247 INFO [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-18 10:11:48,255 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-18 10:11:48,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:48,260 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-18 10:11:48,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-18 10:11:48,290 INFO [Listener at jenkins-hbase4.apache.org/42677] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=747 (was 768), OpenFileDescriptor=890 (was 924), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=425 (was 399) - SystemLoadAverage LEAK? -, ProcessCount=184 (was 183) - ProcessCount LEAK? -, AvailableMemoryMB=2329 (was 2843) 2023-07-18 10:11:48,290 WARN [Listener at jenkins-hbase4.apache.org/42677] hbase.ResourceChecker(130): Thread=747 is superior to 500 2023-07-18 10:11:48,310 INFO [Listener at jenkins-hbase4.apache.org/42677] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=747, OpenFileDescriptor=890, MaxFileDescriptor=60000, SystemLoadAverage=425, ProcessCount=184, AvailableMemoryMB=2325 2023-07-18 10:11:48,310 WARN [Listener at jenkins-hbase4.apache.org/42677] hbase.ResourceChecker(130): Thread=747 is superior to 500 2023-07-18 10:11:48,312 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-18 10:11:48,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,315 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 10:11:48,316 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-18 10:11:48,317 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 10:11:48,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-18 10:11:48,321 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c5c8d1378e8de4b01a65e3a5559754dd 2023-07-18 10:11:48,321 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/61272b39ea7023414fcd976c4b595f1b 2023-07-18 10:11:48,321 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/61272b39ea7023414fcd976c4b595f1b empty. 2023-07-18 10:11:48,322 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c5c8d1378e8de4b01a65e3a5559754dd empty. 2023-07-18 10:11:48,322 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/61272b39ea7023414fcd976c4b595f1b 2023-07-18 10:11:48,322 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c5c8d1378e8de4b01a65e3a5559754dd 2023-07-18 10:11:48,322 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-18 10:11:48,358 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-18 10:11:48,359 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => c5c8d1378e8de4b01a65e3a5559754dd, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689675108311.c5c8d1378e8de4b01a65e3a5559754dd.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp 2023-07-18 10:11:48,360 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 61272b39ea7023414fcd976c4b595f1b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689675108311.61272b39ea7023414fcd976c4b595f1b.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp 2023-07-18 10:11:48,386 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689675108311.c5c8d1378e8de4b01a65e3a5559754dd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:11:48,387 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing c5c8d1378e8de4b01a65e3a5559754dd, disabling compactions & flushes 2023-07-18 10:11:48,388 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689675108311.c5c8d1378e8de4b01a65e3a5559754dd. 2023-07-18 10:11:48,388 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689675108311.c5c8d1378e8de4b01a65e3a5559754dd. 2023-07-18 10:11:48,388 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689675108311.c5c8d1378e8de4b01a65e3a5559754dd. after waiting 0 ms 2023-07-18 10:11:48,388 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689675108311.c5c8d1378e8de4b01a65e3a5559754dd. 2023-07-18 10:11:48,388 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689675108311.c5c8d1378e8de4b01a65e3a5559754dd. 2023-07-18 10:11:48,388 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for c5c8d1378e8de4b01a65e3a5559754dd: 2023-07-18 10:11:48,388 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689675108311.61272b39ea7023414fcd976c4b595f1b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:11:48,389 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 61272b39ea7023414fcd976c4b595f1b, disabling compactions & flushes 2023-07-18 10:11:48,389 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689675108311.61272b39ea7023414fcd976c4b595f1b. 2023-07-18 10:11:48,389 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689675108311.61272b39ea7023414fcd976c4b595f1b. 2023-07-18 10:11:48,389 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689675108311.61272b39ea7023414fcd976c4b595f1b. after waiting 0 ms 2023-07-18 10:11:48,389 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689675108311.61272b39ea7023414fcd976c4b595f1b. 2023-07-18 10:11:48,389 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689675108311.61272b39ea7023414fcd976c4b595f1b. 2023-07-18 10:11:48,389 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 61272b39ea7023414fcd976c4b595f1b: 2023-07-18 10:11:48,392 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 10:11:48,393 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689675108311.c5c8d1378e8de4b01a65e3a5559754dd.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689675108392"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689675108392"}]},"ts":"1689675108392"} 2023-07-18 10:11:48,393 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689675108311.61272b39ea7023414fcd976c4b595f1b.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689675108392"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689675108392"}]},"ts":"1689675108392"} 2023-07-18 10:11:48,398 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-18 10:11:48,399 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 10:11:48,399 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689675108399"}]},"ts":"1689675108399"} 2023-07-18 10:11:48,401 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-18 10:11:48,404 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 10:11:48,405 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 10:11:48,405 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 10:11:48,405 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 10:11:48,405 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 10:11:48,405 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c5c8d1378e8de4b01a65e3a5559754dd, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=61272b39ea7023414fcd976c4b595f1b, ASSIGN}] 2023-07-18 10:11:48,408 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=61272b39ea7023414fcd976c4b595f1b, ASSIGN 2023-07-18 10:11:48,408 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c5c8d1378e8de4b01a65e3a5559754dd, ASSIGN 2023-07-18 10:11:48,409 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=61272b39ea7023414fcd976c4b595f1b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33757,1689675027667; forceNewPlan=false, retain=false 2023-07-18 10:11:48,409 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c5c8d1378e8de4b01a65e3a5559754dd, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40089,1689675027524; forceNewPlan=false, retain=false 2023-07-18 10:11:48,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-18 10:11:48,560 INFO [jenkins-hbase4:46557] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-18 10:11:48,563 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=61272b39ea7023414fcd976c4b595f1b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:48,563 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=c5c8d1378e8de4b01a65e3a5559754dd, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:48,563 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689675108311.61272b39ea7023414fcd976c4b595f1b.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689675108563"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689675108563"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689675108563"}]},"ts":"1689675108563"} 2023-07-18 10:11:48,563 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689675108311.c5c8d1378e8de4b01a65e3a5559754dd.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689675108563"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689675108563"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689675108563"}]},"ts":"1689675108563"} 2023-07-18 10:11:48,565 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure 61272b39ea7023414fcd976c4b595f1b, server=jenkins-hbase4.apache.org,33757,1689675027667}] 2023-07-18 10:11:48,567 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure c5c8d1378e8de4b01a65e3a5559754dd, server=jenkins-hbase4.apache.org,40089,1689675027524}] 2023-07-18 10:11:48,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-18 10:11:48,728 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689675108311.61272b39ea7023414fcd976c4b595f1b. 2023-07-18 10:11:48,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 61272b39ea7023414fcd976c4b595f1b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689675108311.61272b39ea7023414fcd976c4b595f1b.', STARTKEY => '1', ENDKEY => ''} 2023-07-18 10:11:48,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689675108311.61272b39ea7023414fcd976c4b595f1b. service=AccessControlService 2023-07-18 10:11:48,729 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 10:11:48,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 61272b39ea7023414fcd976c4b595f1b 2023-07-18 10:11:48,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689675108311.61272b39ea7023414fcd976c4b595f1b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:11:48,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 61272b39ea7023414fcd976c4b595f1b 2023-07-18 10:11:48,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 61272b39ea7023414fcd976c4b595f1b 2023-07-18 10:11:48,730 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689675108311.c5c8d1378e8de4b01a65e3a5559754dd. 2023-07-18 10:11:48,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c5c8d1378e8de4b01a65e3a5559754dd, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689675108311.c5c8d1378e8de4b01a65e3a5559754dd.', STARTKEY => '', ENDKEY => '1'} 2023-07-18 10:11:48,731 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689675108311.c5c8d1378e8de4b01a65e3a5559754dd. service=AccessControlService 2023-07-18 10:11:48,731 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 10:11:48,731 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion c5c8d1378e8de4b01a65e3a5559754dd 2023-07-18 10:11:48,731 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689675108311.c5c8d1378e8de4b01a65e3a5559754dd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:11:48,731 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c5c8d1378e8de4b01a65e3a5559754dd 2023-07-18 10:11:48,731 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c5c8d1378e8de4b01a65e3a5559754dd 2023-07-18 10:11:48,732 INFO [StoreOpener-61272b39ea7023414fcd976c4b595f1b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 61272b39ea7023414fcd976c4b595f1b 2023-07-18 10:11:48,734 DEBUG [StoreOpener-61272b39ea7023414fcd976c4b595f1b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithMergeRegion/61272b39ea7023414fcd976c4b595f1b/cf 2023-07-18 10:11:48,734 DEBUG [StoreOpener-61272b39ea7023414fcd976c4b595f1b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithMergeRegion/61272b39ea7023414fcd976c4b595f1b/cf 2023-07-18 10:11:48,735 INFO [StoreOpener-c5c8d1378e8de4b01a65e3a5559754dd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c5c8d1378e8de4b01a65e3a5559754dd 2023-07-18 10:11:48,735 INFO [StoreOpener-61272b39ea7023414fcd976c4b595f1b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 61272b39ea7023414fcd976c4b595f1b columnFamilyName cf 2023-07-18 10:11:48,740 INFO [StoreOpener-61272b39ea7023414fcd976c4b595f1b-1] regionserver.HStore(310): Store=61272b39ea7023414fcd976c4b595f1b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 10:11:48,741 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithMergeRegion/61272b39ea7023414fcd976c4b595f1b 2023-07-18 10:11:48,743 DEBUG [StoreOpener-c5c8d1378e8de4b01a65e3a5559754dd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithMergeRegion/c5c8d1378e8de4b01a65e3a5559754dd/cf 2023-07-18 10:11:48,743 DEBUG [StoreOpener-c5c8d1378e8de4b01a65e3a5559754dd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithMergeRegion/c5c8d1378e8de4b01a65e3a5559754dd/cf 2023-07-18 10:11:48,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithMergeRegion/61272b39ea7023414fcd976c4b595f1b 2023-07-18 10:11:48,744 INFO [StoreOpener-c5c8d1378e8de4b01a65e3a5559754dd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c5c8d1378e8de4b01a65e3a5559754dd columnFamilyName cf 2023-07-18 10:11:48,745 INFO [StoreOpener-c5c8d1378e8de4b01a65e3a5559754dd-1] regionserver.HStore(310): Store=c5c8d1378e8de4b01a65e3a5559754dd/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 10:11:48,747 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 61272b39ea7023414fcd976c4b595f1b 2023-07-18 10:11:48,749 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithMergeRegion/c5c8d1378e8de4b01a65e3a5559754dd 2023-07-18 10:11:48,754 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithMergeRegion/c5c8d1378e8de4b01a65e3a5559754dd 2023-07-18 10:11:48,757 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithMergeRegion/61272b39ea7023414fcd976c4b595f1b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 10:11:48,757 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 61272b39ea7023414fcd976c4b595f1b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69646534, jitterRate=0.03781422972679138}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 10:11:48,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 61272b39ea7023414fcd976c4b595f1b: 2023-07-18 10:11:48,759 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689675108311.61272b39ea7023414fcd976c4b595f1b., pid=60, masterSystemTime=1689675108721 2023-07-18 10:11:48,760 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c5c8d1378e8de4b01a65e3a5559754dd 2023-07-18 10:11:48,761 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689675108311.61272b39ea7023414fcd976c4b595f1b. 2023-07-18 10:11:48,761 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689675108311.61272b39ea7023414fcd976c4b595f1b. 2023-07-18 10:11:48,762 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=61272b39ea7023414fcd976c4b595f1b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:48,762 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689675108311.61272b39ea7023414fcd976c4b595f1b.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689675108761"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689675108761"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689675108761"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689675108761"}]},"ts":"1689675108761"} 2023-07-18 10:11:48,766 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-07-18 10:11:48,766 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure 61272b39ea7023414fcd976c4b595f1b, server=jenkins-hbase4.apache.org,33757,1689675027667 in 199 msec 2023-07-18 10:11:48,771 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=61272b39ea7023414fcd976c4b595f1b, ASSIGN in 361 msec 2023-07-18 10:11:48,771 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithMergeRegion/c5c8d1378e8de4b01a65e3a5559754dd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 10:11:48,783 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c5c8d1378e8de4b01a65e3a5559754dd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63083601, jitterRate=-0.0599810928106308}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 10:11:48,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c5c8d1378e8de4b01a65e3a5559754dd: 2023-07-18 10:11:48,784 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689675108311.c5c8d1378e8de4b01a65e3a5559754dd., pid=61, masterSystemTime=1689675108722 2023-07-18 10:11:48,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689675108311.c5c8d1378e8de4b01a65e3a5559754dd. 2023-07-18 10:11:48,787 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689675108311.c5c8d1378e8de4b01a65e3a5559754dd. 2023-07-18 10:11:48,788 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=c5c8d1378e8de4b01a65e3a5559754dd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:48,788 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689675108311.c5c8d1378e8de4b01a65e3a5559754dd.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689675108788"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689675108788"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689675108788"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689675108788"}]},"ts":"1689675108788"} 2023-07-18 10:11:48,793 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=58 2023-07-18 10:11:48,793 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure c5c8d1378e8de4b01a65e3a5559754dd, server=jenkins-hbase4.apache.org,40089,1689675027524 in 223 msec 2023-07-18 10:11:48,796 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=58, resume processing ppid=57 2023-07-18 10:11:48,798 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c5c8d1378e8de4b01a65e3a5559754dd, ASSIGN in 388 msec 2023-07-18 10:11:48,799 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 10:11:48,799 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689675108799"}]},"ts":"1689675108799"} 2023-07-18 10:11:48,801 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-18 10:11:48,804 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 10:11:48,805 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-18 10:11:48,807 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34221] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-18 10:11:48,809 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:11:48,809 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:11:48,809 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:11:48,809 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:11:48,810 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 10:11:48,810 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 10:11:48,811 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 10:11:48,811 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 10:11:48,812 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 498 msec 2023-07-18 10:11:48,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-18 10:11:48,925 INFO [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-18 10:11:48,925 DEBUG [Listener at jenkins-hbase4.apache.org/42677] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithMergeRegion get assigned. Timeout = 60000ms 2023-07-18 10:11:48,925 INFO [Listener at jenkins-hbase4.apache.org/42677] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 10:11:48,929 INFO [Listener at jenkins-hbase4.apache.org/42677] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned to meta. Checking AM states. 2023-07-18 10:11:48,929 INFO [Listener at jenkins-hbase4.apache.org/42677] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 10:11:48,930 INFO [Listener at jenkins-hbase4.apache.org/42677] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned. 2023-07-18 10:11:48,933 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-18 10:11:48,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689675108933 (current time:1689675108933). 2023-07-18 10:11:48,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 10:11:48,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] zookeeper.ReadOnlyZKClient(139): Connect 0x28fccc76 to 127.0.0.1:56089 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 10:11:48,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@bc9c914, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 10:11:48,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:11:48,954 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52262, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:11:48,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x28fccc76 to 127.0.0.1:56089 2023-07-18 10:11:48,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 10:11:48,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] zookeeper.ReadOnlyZKClient(139): Connect 0x5b74cc8b to 127.0.0.1:56089 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 10:11:48,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@152534ef, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 10:11:48,967 DEBUG [hconnection-0x50e1de36-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:11:48,969 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52264, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:11:48,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:11:48,977 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48876, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:11:48,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5b74cc8b to 127.0.0.1:56089 2023-07-18 10:11:48,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 10:11:48,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-18 10:11:48,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 10:11:48,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-18 10:11:48,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-18 10:11:48,984 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-18 10:11:48,985 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689675708985 2023-07-18 10:11:48,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-18 10:11:48,985 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,986 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 10:11:48,987 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 10:11:48,988 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-18 10:11:48,988 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-18 10:11:48,989 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 6 msec 2023-07-18 10:11:48,990 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-18 10:11:48,990 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689675708990 2023-07-18 10:11:49,002 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,003 INFO [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-18 10:11:49,003 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:11:49,004 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-18 10:11:49,004 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-18 10:11:49,004 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,005 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,007 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:11:49,007 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:49,007 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:11:49,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:11:49,007 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:11:49,007 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:11:49,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:11:49,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:11:49,008 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:49,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:11:49,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:11:49,008 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:49,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,008 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,008 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:49,009 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 10:11:49,009 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,009 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-18 10:11:49,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-18 10:11:49,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,009 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-18 10:11:49,009 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-18 10:11:49,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-18 10:11:49,009 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,010 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-18 10:11:49,009 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,010 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-18 10:11:49,010 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-18 10:11:49,010 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:11:49,010 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:11:49,012 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-18 10:11:49,013 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-18 10:11:49,010 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,013 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-18 10:11:49,013 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-18 10:11:49,013 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:11:49,014 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-18 10:11:49,014 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-18 10:11:49,013 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-18 10:11:49,014 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40089,1689675027524' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-18 10:11:49,013 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33757,1689675027667' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-18 10:11:49,015 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34221,1689675027589' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-18 10:11:49,016 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,016 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:49,017 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:49,017 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:49,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:11:49,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:11:49,017 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:11:49,017 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,017 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,018 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:11:49,018 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:11:49,018 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:11:49,018 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:11:49,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:49,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:49,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:49,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:11:49,020 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40089,1689675027524' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-18 10:11:49,020 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1b134d24[Count = 1] remaining members to acquire global barrier 2023-07-18 10:11:49,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:49,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:11:49,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:11:49,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:11:49,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:11:49,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:49,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:49,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:49,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:11:49,023 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33757,1689675027667' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-18 10:11:49,023 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1b134d24[Count = 0] remaining members to acquire global barrier 2023-07-18 10:11:49,023 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-18 10:11:49,023 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,024 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,024 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,024 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,025 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-18 10:11:49,025 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:49,025 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,025 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,025 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:49,025 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-18 10:11:49,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,026 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-18 10:11:49,026 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-18 10:11:49,025 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 10:11:49,026 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,34221,1689675027589' in zk 2023-07-18 10:11:49,026 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 10:11:49,027 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 10:11:49,027 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689675108311.61272b39ea7023414fcd976c4b595f1b. 2023-07-18 10:11:49,027 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689675108311.61272b39ea7023414fcd976c4b595f1b. started... 2023-07-18 10:11:49,027 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 10:11:49,028 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 10:11:49,028 DEBUG [rs(jenkins-hbase4.apache.org,40089,1689675027524)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689675108311.c5c8d1378e8de4b01a65e3a5559754dd. 2023-07-18 10:11:49,028 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 61272b39ea7023414fcd976c4b595f1b: 2023-07-18 10:11:49,029 DEBUG [rs(jenkins-hbase4.apache.org,40089,1689675027524)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689675108311.c5c8d1378e8de4b01a65e3a5559754dd. started... 2023-07-18 10:11:49,030 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689675108311.61272b39ea7023414fcd976c4b595f1b.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,030 DEBUG [rs(jenkins-hbase4.apache.org,40089,1689675027524)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c5c8d1378e8de4b01a65e3a5559754dd: 2023-07-18 10:11:49,030 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 10:11:49,030 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 10:11:49,030 DEBUG [rs(jenkins-hbase4.apache.org,40089,1689675027524)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689675108311.c5c8d1378e8de4b01a65e3a5559754dd.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,030 DEBUG [rs(jenkins-hbase4.apache.org,40089,1689675027524)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 10:11:49,030 DEBUG [rs(jenkins-hbase4.apache.org,40089,1689675027524)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 10:11:49,034 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-18 10:11:49,034 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:11:49,034 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-18 10:11:49,077 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689675108311.61272b39ea7023414fcd976c4b595f1b. completed. 2023-07-18 10:11:49,077 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689675108311.61272b39ea7023414fcd976c4b595f1b. 2023-07-18 10:11:49,077 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 10:11:49,090 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 10:11:49,091 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:49,091 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-18 10:11:49,091 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,33757,1689675027667' in zk 2023-07-18 10:11:49,087 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 10:11:49,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-18 10:11:49,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-18 10:11:49,093 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-18 10:11:49,093 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:11:49,093 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-18 10:11:49,093 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:49,093 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 10:11:49,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:49,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:11:49,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:11:49,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:11:49,096 DEBUG [rs(jenkins-hbase4.apache.org,40089,1689675027524)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689675108311.c5c8d1378e8de4b01a65e3a5559754dd. completed. 2023-07-18 10:11:49,096 DEBUG [rs(jenkins-hbase4.apache.org,40089,1689675027524)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689675108311.c5c8d1378e8de4b01a65e3a5559754dd. 2023-07-18 10:11:49,096 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 10:11:49,096 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 10:11:49,096 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:49,096 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-18 10:11:49,096 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,40089,1689675027524' in zk 2023-07-18 10:11:49,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:11:49,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,098 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-18 10:11:49,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:49,098 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:11:49,098 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-18 10:11:49,098 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:49,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:49,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:49,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:11:49,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:49,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:49,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:49,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,33757,1689675027667': 2023-07-18 10:11:49,114 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33757,1689675027667' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-18 10:11:49,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:49,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:11:49,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:11:49,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:11:49,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:11:49,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:49,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:49,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:49,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:11:49,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:49,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:49,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:49,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,40089,1689675027524': 2023-07-18 10:11:49,120 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40089,1689675027524' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-18 10:11:49,120 INFO [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-18 10:11:49,120 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 10:11:49,120 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 10:11:49,120 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,120 INFO [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 10:11:49,122 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,122 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,122 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,122 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:11:49,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:11:49,123 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:11:49,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,123 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:11:49,122 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:11:49,122 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:11:49,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:11:49,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:11:49,124 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:49,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:11:49,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:11:49,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:11:49,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:11:49,124 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:49,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:11:49,125 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:49,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:49,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:49,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:49,128 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:49,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:11:49,128 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:49,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,128 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:49,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:49,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:49,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:49,135 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:11:49,135 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:11:49,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:11:49,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:11:49,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:11:49,135 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:11:49,135 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:49,135 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:11:49,135 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:11:49,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:11:49,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:11:49,135 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:11:49,135 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:11:49,135 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:11:49,135 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,136 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:49,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:11:49,137 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:49,138 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:11:49,136 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:11:49,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:11:49,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:11:49,138 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:49,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:11:49,138 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,138 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:49,138 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:49,138 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,138 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,139 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,248 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,294 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 10:11:49,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-18 10:11:49,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-18 10:11:49,295 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-18 10:11:49,339 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-18 10:11:49,340 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,340 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,340 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689675108985Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689675109136 (+151 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689675109138 (+2 ms)Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689675109170 (+32 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689675109233 (+63 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689675109339 (+106 ms) 2023-07-18 10:11:49,344 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-18 10:11:49,346 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 358 msec 2023-07-18 10:11:49,595 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 10:11:49,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-18 10:11:49,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 10:11:49,639 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33757] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689675108311.61272b39ea7023414fcd976c4b595f1b. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 10:11:49,643 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40089] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689675108311.c5c8d1378e8de4b01a65e3a5559754dd. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 10:11:49,651 DEBUG [Listener at jenkins-hbase4.apache.org/42677] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,651 DEBUG [Listener at jenkins-hbase4.apache.org/42677] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689675108311.c5c8d1378e8de4b01a65e3a5559754dd. 2023-07-18 10:11:49,653 INFO [Listener at jenkins-hbase4.apache.org/42677] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 10:11:49,674 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-18 10:11:49,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689675109674 (current time:1689675109674). 2023-07-18 10:11:49,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 10:11:49,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] zookeeper.ReadOnlyZKClient(139): Connect 0x101f79b5 to 127.0.0.1:56089 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 10:11:49,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@dd95b7b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 10:11:49,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:11:49,690 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52268, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:11:49,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x101f79b5 to 127.0.0.1:56089 2023-07-18 10:11:49,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 10:11:49,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] zookeeper.ReadOnlyZKClient(139): Connect 0x47aad327 to 127.0.0.1:56089 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 10:11:49,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2c93c8b6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 10:11:49,707 DEBUG [hconnection-0x6b564cdc-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:11:49,711 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52272, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:11:49,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:11:49,720 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48880, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:11:49,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x47aad327 to 127.0.0.1:56089 2023-07-18 10:11:49,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 10:11:49,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-18 10:11:49,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 10:11:49,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-18 10:11:49,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-18 10:11:49,727 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-18 10:11:49,728 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689675709728 2023-07-18 10:11:49,728 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-18 10:11:49,730 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 10:11:49,730 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 10:11:49,731 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-18 10:11:49,731 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-18 10:11:49,733 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 6 msec 2023-07-18 10:11:49,733 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-18 10:11:49,734 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689675709734 2023-07-18 10:11:49,756 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,756 INFO [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-18 10:11:49,756 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:11:49,758 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-18 10:11:49,758 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-18 10:11:49,759 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,759 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,760 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:11:49,761 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:11:49,761 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:11:49,761 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:11:49,761 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:11:49,761 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:11:49,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:11:49,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:11:49,761 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:49,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:11:49,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,761 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:49,762 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:49,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,762 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,762 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,763 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:49,763 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 10:11:49,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-18 10:11:49,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-18 10:11:49,763 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,763 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-18 10:11:49,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,764 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-18 10:11:49,764 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,764 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-18 10:11:49,764 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:11:49,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-18 10:11:49,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,768 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-18 10:11:49,768 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-18 10:11:49,764 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,768 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34221,1689675027589' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-18 10:11:49,768 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-18 10:11:49,768 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-18 10:11:49,768 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:11:49,770 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-18 10:11:49,770 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-18 10:11:49,770 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33757,1689675027667' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-18 10:11:49,770 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,770 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-18 10:11:49,770 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:11:49,771 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-18 10:11:49,771 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-18 10:11:49,771 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40089,1689675027524' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-18 10:11:49,773 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,774 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,774 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:49,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:49,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:11:49,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:11:49,776 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:49,776 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,776 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,776 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,776 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:11:49,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:11:49,776 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:11:49,776 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,776 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:11:49,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:11:49,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:49,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:49,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:49,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:11:49,779 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33757,1689675027667' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-18 10:11:49,779 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@20d581ac[Count = 1] remaining members to acquire global barrier 2023-07-18 10:11:49,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:49,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:11:49,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:11:49,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:11:49,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:11:49,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:49,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:49,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:49,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:11:49,781 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40089,1689675027524' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-18 10:11:49,782 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@20d581ac[Count = 0] remaining members to acquire global barrier 2023-07-18 10:11:49,782 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-18 10:11:49,782 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,783 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,783 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,783 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,783 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-18 10:11:49,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,783 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:49,783 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 10:11:49,783 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 10:11:49,783 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-18 10:11:49,783 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-18 10:11:49,784 DEBUG [rs(jenkins-hbase4.apache.org,40089,1689675027524)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689675108311.c5c8d1378e8de4b01a65e3a5559754dd. 2023-07-18 10:11:49,784 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-18 10:11:49,784 DEBUG [rs(jenkins-hbase4.apache.org,40089,1689675027524)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689675108311.c5c8d1378e8de4b01a65e3a5559754dd. started... 2023-07-18 10:11:49,784 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:49,784 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 10:11:49,784 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,34221,1689675027589' in zk 2023-07-18 10:11:49,784 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689675108311.61272b39ea7023414fcd976c4b595f1b. 2023-07-18 10:11:49,784 INFO [rs(jenkins-hbase4.apache.org,40089,1689675027524)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c5c8d1378e8de4b01a65e3a5559754dd 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-18 10:11:49,784 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 10:11:49,784 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 10:11:49,784 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689675108311.61272b39ea7023414fcd976c4b595f1b. started... 2023-07-18 10:11:49,784 INFO [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 61272b39ea7023414fcd976c4b595f1b 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-18 10:11:49,785 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-18 10:11:49,785 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:11:49,786 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-18 10:11:49,809 INFO [rs(jenkins-hbase4.apache.org,40089,1689675027524)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=333 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithMergeRegion/c5c8d1378e8de4b01a65e3a5559754dd/.tmp/cf/5133c223ddeb4f2fa13b7e5ec8ea8126 2023-07-18 10:11:49,812 INFO [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.93 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithMergeRegion/61272b39ea7023414fcd976c4b595f1b/.tmp/cf/9b020f9e23e043b19414f86d72e20aa2 2023-07-18 10:11:49,817 DEBUG [rs(jenkins-hbase4.apache.org,40089,1689675027524)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithMergeRegion/c5c8d1378e8de4b01a65e3a5559754dd/.tmp/cf/5133c223ddeb4f2fa13b7e5ec8ea8126 as hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithMergeRegion/c5c8d1378e8de4b01a65e3a5559754dd/cf/5133c223ddeb4f2fa13b7e5ec8ea8126 2023-07-18 10:11:49,825 INFO [rs(jenkins-hbase4.apache.org,40089,1689675027524)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithMergeRegion/c5c8d1378e8de4b01a65e3a5559754dd/cf/5133c223ddeb4f2fa13b7e5ec8ea8126, entries=5, sequenceid=6, filesize=5.2 K 2023-07-18 10:11:49,825 INFO [rs(jenkins-hbase4.apache.org,40089,1689675027524)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for c5c8d1378e8de4b01a65e3a5559754dd in 41ms, sequenceid=6, compaction requested=false 2023-07-18 10:11:49,826 DEBUG [rs(jenkins-hbase4.apache.org,40089,1689675027524)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-18 10:11:49,826 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithMergeRegion/61272b39ea7023414fcd976c4b595f1b/.tmp/cf/9b020f9e23e043b19414f86d72e20aa2 as hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithMergeRegion/61272b39ea7023414fcd976c4b595f1b/cf/9b020f9e23e043b19414f86d72e20aa2 2023-07-18 10:11:49,828 DEBUG [rs(jenkins-hbase4.apache.org,40089,1689675027524)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c5c8d1378e8de4b01a65e3a5559754dd: 2023-07-18 10:11:49,828 DEBUG [rs(jenkins-hbase4.apache.org,40089,1689675027524)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689675108311.c5c8d1378e8de4b01a65e3a5559754dd.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,828 DEBUG [rs(jenkins-hbase4.apache.org,40089,1689675027524)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 10:11:49,828 DEBUG [rs(jenkins-hbase4.apache.org,40089,1689675027524)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithMergeRegion/c5c8d1378e8de4b01a65e3a5559754dd/cf/5133c223ddeb4f2fa13b7e5ec8ea8126] hfiles 2023-07-18 10:11:49,828 DEBUG [rs(jenkins-hbase4.apache.org,40089,1689675027524)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithMergeRegion/c5c8d1378e8de4b01a65e3a5559754dd/cf/5133c223ddeb4f2fa13b7e5ec8ea8126 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,830 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 10:11:49,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-18 10:11:49,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-18 10:11:49,833 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 10:11:49,840 INFO [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithMergeRegion/61272b39ea7023414fcd976c4b595f1b/cf/9b020f9e23e043b19414f86d72e20aa2, entries=45, sequenceid=6, filesize=7.9 K 2023-07-18 10:11:49,841 INFO [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 61272b39ea7023414fcd976c4b595f1b in 57ms, sequenceid=6, compaction requested=false 2023-07-18 10:11:49,843 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 61272b39ea7023414fcd976c4b595f1b: 2023-07-18 10:11:49,843 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689675108311.61272b39ea7023414fcd976c4b595f1b.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,843 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 10:11:49,843 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithMergeRegion/61272b39ea7023414fcd976c4b595f1b/cf/9b020f9e23e043b19414f86d72e20aa2] hfiles 2023-07-18 10:11:49,844 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithMergeRegion/61272b39ea7023414fcd976c4b595f1b/cf/9b020f9e23e043b19414f86d72e20aa2 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,844 DEBUG [rs(jenkins-hbase4.apache.org,40089,1689675027524)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689675108311.c5c8d1378e8de4b01a65e3a5559754dd. completed. 2023-07-18 10:11:49,844 DEBUG [rs(jenkins-hbase4.apache.org,40089,1689675027524)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689675108311.c5c8d1378e8de4b01a65e3a5559754dd. 2023-07-18 10:11:49,844 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 10:11:49,844 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 10:11:49,844 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:49,844 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-18 10:11:49,844 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,40089,1689675027524' in zk 2023-07-18 10:11:49,846 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-18 10:11:49,846 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:49,846 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:11:49,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:49,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:11:49,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:11:49,846 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-18 10:11:49,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:11:49,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:11:49,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:49,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:49,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:49,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:11:49,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:49,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:49,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,40089,1689675027524': 2023-07-18 10:11:49,852 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40089,1689675027524' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-18 10:11:49,858 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689675108311.61272b39ea7023414fcd976c4b595f1b. completed. 2023-07-18 10:11:49,859 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689675108311.61272b39ea7023414fcd976c4b595f1b. 2023-07-18 10:11:49,859 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 10:11:49,859 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 10:11:49,859 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:49,859 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-18 10:11:49,859 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,33757,1689675027667' in zk 2023-07-18 10:11:49,862 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:49,862 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-18 10:11:49,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:49,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:11:49,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:11:49,862 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:11:49,862 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-18 10:11:49,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:11:49,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:11:49,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:49,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:49,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:49,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:11:49,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:49,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:49,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:49,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,33757,1689675027667': 2023-07-18 10:11:49,867 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33757,1689675027667' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-18 10:11:49,867 INFO [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-18 10:11:49,867 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 10:11:49,867 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 10:11:49,867 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,867 INFO [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 10:11:49,877 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,877 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:11:49,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:11:49,877 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,877 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,878 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:11:49,877 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:11:49,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,877 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:11:49,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:11:49,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:11:49,878 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:49,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:11:49,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:11:49,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:11:49,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,879 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:49,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:11:49,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:11:49,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:11:49,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,879 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:49,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:49,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:49,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:49,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:11:49,881 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:49,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,882 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:49,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:49,882 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:49,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:49,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:49,885 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:49,885 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,885 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:11:49,885 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:49,886 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:11:49,886 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:11:49,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:11:49,885 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:11:49,886 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:11:49,886 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:11:49,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:11:49,886 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:11:49,886 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:11:49,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:11:49,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:11:49,886 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:49,888 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,888 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:49,888 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,888 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:49,888 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:49,888 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,888 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:11:49,886 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:11:49,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:11:49,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:11:49,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:11:49,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:11:49,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:11:49,889 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,922 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,974 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-18 10:11:49,975 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,975 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,975 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689675109728Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689675109886 (+158 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689675109888 (+2 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689675109893 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689675109907 (+14 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689675109974 (+67 ms) 2023-07-18 10:11:49,978 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-18 10:11:49,987 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 249 msec 2023-07-18 10:11:50,033 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 10:11:50,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-18 10:11:50,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 10:11:50,066 DEBUG [Listener at jenkins-hbase4.apache.org/42677] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-18 10:11:50,070 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34970, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-18 10:11:50,072 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33757] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-18 10:11:50,072 DEBUG [Listener at jenkins-hbase4.apache.org/42677] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-18 10:11:50,077 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48888, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-18 10:11:50,078 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34221] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-18 10:11:50,078 DEBUG [Listener at jenkins-hbase4.apache.org/42677] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-18 10:11:50,081 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52282, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-18 10:11:50,081 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40089] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-18 10:11:50,083 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-18 10:11:50,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:50,089 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 10:11:50,089 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-18 10:11:50,091 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 10:11:50,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-18 10:11:50,097 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8ad6a328546bcebe5eca9cc995a7ff1b 2023-07-18 10:11:50,097 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0bd51a8e185e8e5398d32c37ac921aac 2023-07-18 10:11:50,098 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8ad6a328546bcebe5eca9cc995a7ff1b empty. 2023-07-18 10:11:50,098 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0bd51a8e185e8e5398d32c37ac921aac empty. 2023-07-18 10:11:50,098 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8ad6a328546bcebe5eca9cc995a7ff1b 2023-07-18 10:11:50,099 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0bd51a8e185e8e5398d32c37ac921aac 2023-07-18 10:11:50,099 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-18 10:11:50,135 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-18 10:11:50,136 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 8ad6a328546bcebe5eca9cc995a7ff1b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689675110083.8ad6a328546bcebe5eca9cc995a7ff1b.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp 2023-07-18 10:11:50,137 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 0bd51a8e185e8e5398d32c37ac921aac, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689675110083.0bd51a8e185e8e5398d32c37ac921aac.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp 2023-07-18 10:11:50,175 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689675110083.8ad6a328546bcebe5eca9cc995a7ff1b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:11:50,180 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 8ad6a328546bcebe5eca9cc995a7ff1b, disabling compactions & flushes 2023-07-18 10:11:50,180 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689675110083.8ad6a328546bcebe5eca9cc995a7ff1b. 2023-07-18 10:11:50,180 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689675110083.8ad6a328546bcebe5eca9cc995a7ff1b. 2023-07-18 10:11:50,180 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689675110083.8ad6a328546bcebe5eca9cc995a7ff1b. after waiting 0 ms 2023-07-18 10:11:50,180 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689675110083.8ad6a328546bcebe5eca9cc995a7ff1b. 2023-07-18 10:11:50,180 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689675110083.8ad6a328546bcebe5eca9cc995a7ff1b. 2023-07-18 10:11:50,180 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 8ad6a328546bcebe5eca9cc995a7ff1b: 2023-07-18 10:11:50,182 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689675110083.0bd51a8e185e8e5398d32c37ac921aac.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:11:50,182 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 0bd51a8e185e8e5398d32c37ac921aac, disabling compactions & flushes 2023-07-18 10:11:50,182 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689675110083.0bd51a8e185e8e5398d32c37ac921aac. 2023-07-18 10:11:50,182 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689675110083.0bd51a8e185e8e5398d32c37ac921aac. 2023-07-18 10:11:50,182 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689675110083.0bd51a8e185e8e5398d32c37ac921aac. after waiting 0 ms 2023-07-18 10:11:50,182 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689675110083.0bd51a8e185e8e5398d32c37ac921aac. 2023-07-18 10:11:50,182 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689675110083.0bd51a8e185e8e5398d32c37ac921aac. 2023-07-18 10:11:50,182 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 0bd51a8e185e8e5398d32c37ac921aac: 2023-07-18 10:11:50,185 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 10:11:50,186 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689675110083.8ad6a328546bcebe5eca9cc995a7ff1b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689675110186"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689675110186"}]},"ts":"1689675110186"} 2023-07-18 10:11:50,186 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689675110083.0bd51a8e185e8e5398d32c37ac921aac.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689675110186"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689675110186"}]},"ts":"1689675110186"} 2023-07-18 10:11:50,190 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-18 10:11:50,192 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 10:11:50,192 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689675110192"}]},"ts":"1689675110192"} 2023-07-18 10:11:50,193 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-18 10:11:50,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-18 10:11:50,267 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 10:11:50,269 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 10:11:50,269 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 10:11:50,269 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 10:11:50,269 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 10:11:50,270 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8ad6a328546bcebe5eca9cc995a7ff1b, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0bd51a8e185e8e5398d32c37ac921aac, ASSIGN}] 2023-07-18 10:11:50,276 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0bd51a8e185e8e5398d32c37ac921aac, ASSIGN 2023-07-18 10:11:50,276 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8ad6a328546bcebe5eca9cc995a7ff1b, ASSIGN 2023-07-18 10:11:50,278 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0bd51a8e185e8e5398d32c37ac921aac, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34221,1689675027589; forceNewPlan=false, retain=false 2023-07-18 10:11:50,278 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8ad6a328546bcebe5eca9cc995a7ff1b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33757,1689675027667; forceNewPlan=false, retain=false 2023-07-18 10:11:50,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-18 10:11:50,428 INFO [jenkins-hbase4:46557] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-18 10:11:50,432 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=0bd51a8e185e8e5398d32c37ac921aac, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:50,432 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=8ad6a328546bcebe5eca9cc995a7ff1b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:50,432 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689675110083.0bd51a8e185e8e5398d32c37ac921aac.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689675110431"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689675110431"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689675110431"}]},"ts":"1689675110431"} 2023-07-18 10:11:50,432 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689675110083.8ad6a328546bcebe5eca9cc995a7ff1b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689675110431"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689675110431"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689675110431"}]},"ts":"1689675110431"} 2023-07-18 10:11:50,434 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 8ad6a328546bcebe5eca9cc995a7ff1b, server=jenkins-hbase4.apache.org,33757,1689675027667}] 2023-07-18 10:11:50,435 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure 0bd51a8e185e8e5398d32c37ac921aac, server=jenkins-hbase4.apache.org,34221,1689675027589}] 2023-07-18 10:11:50,591 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689675110083.0bd51a8e185e8e5398d32c37ac921aac. 2023-07-18 10:11:50,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0bd51a8e185e8e5398d32c37ac921aac, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689675110083.0bd51a8e185e8e5398d32c37ac921aac.', STARTKEY => '2', ENDKEY => ''} 2023-07-18 10:11:50,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689675110083.0bd51a8e185e8e5398d32c37ac921aac. service=AccessControlService 2023-07-18 10:11:50,592 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 10:11:50,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 0bd51a8e185e8e5398d32c37ac921aac 2023-07-18 10:11:50,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689675110083.0bd51a8e185e8e5398d32c37ac921aac.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:11:50,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0bd51a8e185e8e5398d32c37ac921aac 2023-07-18 10:11:50,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0bd51a8e185e8e5398d32c37ac921aac 2023-07-18 10:11:50,595 INFO [StoreOpener-0bd51a8e185e8e5398d32c37ac921aac-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0bd51a8e185e8e5398d32c37ac921aac 2023-07-18 10:11:50,597 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689675110083.8ad6a328546bcebe5eca9cc995a7ff1b. 2023-07-18 10:11:50,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8ad6a328546bcebe5eca9cc995a7ff1b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689675110083.8ad6a328546bcebe5eca9cc995a7ff1b.', STARTKEY => '', ENDKEY => '2'} 2023-07-18 10:11:50,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689675110083.8ad6a328546bcebe5eca9cc995a7ff1b. service=AccessControlService 2023-07-18 10:11:50,597 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 10:11:50,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 8ad6a328546bcebe5eca9cc995a7ff1b 2023-07-18 10:11:50,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689675110083.8ad6a328546bcebe5eca9cc995a7ff1b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:11:50,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8ad6a328546bcebe5eca9cc995a7ff1b 2023-07-18 10:11:50,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8ad6a328546bcebe5eca9cc995a7ff1b 2023-07-18 10:11:50,600 DEBUG [StoreOpener-0bd51a8e185e8e5398d32c37ac921aac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0bd51a8e185e8e5398d32c37ac921aac/cf 2023-07-18 10:11:50,601 DEBUG [StoreOpener-0bd51a8e185e8e5398d32c37ac921aac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0bd51a8e185e8e5398d32c37ac921aac/cf 2023-07-18 10:11:50,601 INFO [StoreOpener-8ad6a328546bcebe5eca9cc995a7ff1b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8ad6a328546bcebe5eca9cc995a7ff1b 2023-07-18 10:11:50,601 INFO [StoreOpener-0bd51a8e185e8e5398d32c37ac921aac-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0bd51a8e185e8e5398d32c37ac921aac columnFamilyName cf 2023-07-18 10:11:50,602 INFO [StoreOpener-0bd51a8e185e8e5398d32c37ac921aac-1] regionserver.HStore(310): Store=0bd51a8e185e8e5398d32c37ac921aac/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 10:11:50,603 DEBUG [StoreOpener-8ad6a328546bcebe5eca9cc995a7ff1b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8ad6a328546bcebe5eca9cc995a7ff1b/cf 2023-07-18 10:11:50,603 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0bd51a8e185e8e5398d32c37ac921aac 2023-07-18 10:11:50,603 DEBUG [StoreOpener-8ad6a328546bcebe5eca9cc995a7ff1b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8ad6a328546bcebe5eca9cc995a7ff1b/cf 2023-07-18 10:11:50,604 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0bd51a8e185e8e5398d32c37ac921aac 2023-07-18 10:11:50,604 INFO [StoreOpener-8ad6a328546bcebe5eca9cc995a7ff1b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8ad6a328546bcebe5eca9cc995a7ff1b columnFamilyName cf 2023-07-18 10:11:50,605 INFO [StoreOpener-8ad6a328546bcebe5eca9cc995a7ff1b-1] regionserver.HStore(310): Store=8ad6a328546bcebe5eca9cc995a7ff1b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 10:11:50,606 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8ad6a328546bcebe5eca9cc995a7ff1b 2023-07-18 10:11:50,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8ad6a328546bcebe5eca9cc995a7ff1b 2023-07-18 10:11:50,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0bd51a8e185e8e5398d32c37ac921aac 2023-07-18 10:11:50,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8ad6a328546bcebe5eca9cc995a7ff1b 2023-07-18 10:11:50,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0bd51a8e185e8e5398d32c37ac921aac/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 10:11:50,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8ad6a328546bcebe5eca9cc995a7ff1b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 10:11:50,616 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8ad6a328546bcebe5eca9cc995a7ff1b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60452934, jitterRate=-0.09918108582496643}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 10:11:50,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8ad6a328546bcebe5eca9cc995a7ff1b: 2023-07-18 10:11:50,617 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0bd51a8e185e8e5398d32c37ac921aac; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73241872, jitterRate=0.09138894081115723}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 10:11:50,617 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0bd51a8e185e8e5398d32c37ac921aac: 2023-07-18 10:11:50,617 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689675110083.8ad6a328546bcebe5eca9cc995a7ff1b., pid=69, masterSystemTime=1689675110586 2023-07-18 10:11:50,618 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689675110083.0bd51a8e185e8e5398d32c37ac921aac., pid=70, masterSystemTime=1689675110587 2023-07-18 10:11:50,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689675110083.8ad6a328546bcebe5eca9cc995a7ff1b. 2023-07-18 10:11:50,619 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689675110083.8ad6a328546bcebe5eca9cc995a7ff1b. 2023-07-18 10:11:50,620 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=8ad6a328546bcebe5eca9cc995a7ff1b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:50,620 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689675110083.0bd51a8e185e8e5398d32c37ac921aac. 2023-07-18 10:11:50,620 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689675110083.8ad6a328546bcebe5eca9cc995a7ff1b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689675110620"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689675110620"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689675110620"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689675110620"}]},"ts":"1689675110620"} 2023-07-18 10:11:50,620 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689675110083.0bd51a8e185e8e5398d32c37ac921aac. 2023-07-18 10:11:50,622 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=0bd51a8e185e8e5398d32c37ac921aac, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:50,622 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689675110083.0bd51a8e185e8e5398d32c37ac921aac.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689675110622"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689675110622"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689675110622"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689675110622"}]},"ts":"1689675110622"} 2023-07-18 10:11:50,626 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-07-18 10:11:50,626 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 8ad6a328546bcebe5eca9cc995a7ff1b, server=jenkins-hbase4.apache.org,33757,1689675027667 in 188 msec 2023-07-18 10:11:50,627 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=68 2023-07-18 10:11:50,627 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure 0bd51a8e185e8e5398d32c37ac921aac, server=jenkins-hbase4.apache.org,34221,1689675027589 in 190 msec 2023-07-18 10:11:50,628 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8ad6a328546bcebe5eca9cc995a7ff1b, ASSIGN in 356 msec 2023-07-18 10:11:50,629 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=66 2023-07-18 10:11:50,629 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0bd51a8e185e8e5398d32c37ac921aac, ASSIGN in 357 msec 2023-07-18 10:11:50,630 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 10:11:50,630 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689675110630"}]},"ts":"1689675110630"} 2023-07-18 10:11:50,631 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-18 10:11:50,634 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 10:11:50,634 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-18 10:11:50,636 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34221] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-18 10:11:50,638 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:11:50,638 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:11:50,638 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:11:50,638 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:11:50,640 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 10:11:50,640 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 10:11:50,641 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-18 10:11:50,641 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 10:11:50,641 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-18 10:11:50,641 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 10:11:50,641 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-18 10:11:50,641 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-18 10:11:50,642 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 558 msec 2023-07-18 10:11:50,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-18 10:11:50,697 INFO [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-18 10:11:50,725 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 8ad6a328546bcebe5eca9cc995a7ff1b, 0bd51a8e185e8e5398d32c37ac921aac 2023-07-18 10:11:50,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[8ad6a328546bcebe5eca9cc995a7ff1b, 0bd51a8e185e8e5398d32c37ac921aac], force=true 2023-07-18 10:11:50,738 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[8ad6a328546bcebe5eca9cc995a7ff1b, 0bd51a8e185e8e5398d32c37ac921aac], force=true 2023-07-18 10:11:50,738 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[8ad6a328546bcebe5eca9cc995a7ff1b, 0bd51a8e185e8e5398d32c37ac921aac], force=true 2023-07-18 10:11:50,738 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[8ad6a328546bcebe5eca9cc995a7ff1b, 0bd51a8e185e8e5398d32c37ac921aac], force=true 2023-07-18 10:11:50,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-18 10:11:50,772 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8ad6a328546bcebe5eca9cc995a7ff1b, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0bd51a8e185e8e5398d32c37ac921aac, UNASSIGN}] 2023-07-18 10:11:50,778 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0bd51a8e185e8e5398d32c37ac921aac, UNASSIGN 2023-07-18 10:11:50,778 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8ad6a328546bcebe5eca9cc995a7ff1b, UNASSIGN 2023-07-18 10:11:50,779 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=8ad6a328546bcebe5eca9cc995a7ff1b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:50,779 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=0bd51a8e185e8e5398d32c37ac921aac, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:50,779 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689675110083.8ad6a328546bcebe5eca9cc995a7ff1b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689675110779"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689675110779"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689675110779"}]},"ts":"1689675110779"} 2023-07-18 10:11:50,779 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689675110083.0bd51a8e185e8e5398d32c37ac921aac.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689675110779"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689675110779"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689675110779"}]},"ts":"1689675110779"} 2023-07-18 10:11:50,780 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure 8ad6a328546bcebe5eca9cc995a7ff1b, server=jenkins-hbase4.apache.org,33757,1689675027667}] 2023-07-18 10:11:50,781 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 0bd51a8e185e8e5398d32c37ac921aac, server=jenkins-hbase4.apache.org,34221,1689675027589}] 2023-07-18 10:11:50,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-18 10:11:50,933 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 8ad6a328546bcebe5eca9cc995a7ff1b 2023-07-18 10:11:50,935 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8ad6a328546bcebe5eca9cc995a7ff1b, disabling compactions & flushes 2023-07-18 10:11:50,935 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689675110083.8ad6a328546bcebe5eca9cc995a7ff1b. 2023-07-18 10:11:50,935 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689675110083.8ad6a328546bcebe5eca9cc995a7ff1b. 2023-07-18 10:11:50,935 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689675110083.8ad6a328546bcebe5eca9cc995a7ff1b. after waiting 0 ms 2023-07-18 10:11:50,935 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689675110083.8ad6a328546bcebe5eca9cc995a7ff1b. 2023-07-18 10:11:50,935 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 8ad6a328546bcebe5eca9cc995a7ff1b 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-18 10:11:50,935 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0bd51a8e185e8e5398d32c37ac921aac 2023-07-18 10:11:50,937 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0bd51a8e185e8e5398d32c37ac921aac, disabling compactions & flushes 2023-07-18 10:11:50,937 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689675110083.0bd51a8e185e8e5398d32c37ac921aac. 2023-07-18 10:11:50,937 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689675110083.0bd51a8e185e8e5398d32c37ac921aac. 2023-07-18 10:11:50,937 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689675110083.0bd51a8e185e8e5398d32c37ac921aac. after waiting 0 ms 2023-07-18 10:11:50,937 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689675110083.0bd51a8e185e8e5398d32c37ac921aac. 2023-07-18 10:11:50,937 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 0bd51a8e185e8e5398d32c37ac921aac 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-18 10:11:50,982 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8ad6a328546bcebe5eca9cc995a7ff1b/.tmp/cf/4e9042cc993e431ea07b48401863f484 2023-07-18 10:11:50,988 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8ad6a328546bcebe5eca9cc995a7ff1b/.tmp/cf/4e9042cc993e431ea07b48401863f484 as hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8ad6a328546bcebe5eca9cc995a7ff1b/cf/4e9042cc993e431ea07b48401863f484 2023-07-18 10:11:50,993 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8ad6a328546bcebe5eca9cc995a7ff1b/cf/4e9042cc993e431ea07b48401863f484, entries=1, sequenceid=5, filesize=4.7 K 2023-07-18 10:11:50,994 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 8ad6a328546bcebe5eca9cc995a7ff1b in 59ms, sequenceid=5, compaction requested=false 2023-07-18 10:11:50,994 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-18 10:11:51,002 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8ad6a328546bcebe5eca9cc995a7ff1b/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-18 10:11:51,003 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 10:11:51,003 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689675110083.8ad6a328546bcebe5eca9cc995a7ff1b. 2023-07-18 10:11:51,003 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8ad6a328546bcebe5eca9cc995a7ff1b: 2023-07-18 10:11:51,004 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 8ad6a328546bcebe5eca9cc995a7ff1b 2023-07-18 10:11:51,005 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=8ad6a328546bcebe5eca9cc995a7ff1b, regionState=CLOSED 2023-07-18 10:11:51,005 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689675110083.8ad6a328546bcebe5eca9cc995a7ff1b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689675111005"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689675111005"}]},"ts":"1689675111005"} 2023-07-18 10:11:51,012 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=72 2023-07-18 10:11:51,012 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure 8ad6a328546bcebe5eca9cc995a7ff1b, server=jenkins-hbase4.apache.org,33757,1689675027667 in 231 msec 2023-07-18 10:11:51,013 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8ad6a328546bcebe5eca9cc995a7ff1b, UNASSIGN in 243 msec 2023-07-18 10:11:51,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-18 10:11:51,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-18 10:11:51,381 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0bd51a8e185e8e5398d32c37ac921aac/.tmp/cf/d0a71ed3300a478fae4ce11eaa4b98c5 2023-07-18 10:11:51,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0bd51a8e185e8e5398d32c37ac921aac/.tmp/cf/d0a71ed3300a478fae4ce11eaa4b98c5 as hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0bd51a8e185e8e5398d32c37ac921aac/cf/d0a71ed3300a478fae4ce11eaa4b98c5 2023-07-18 10:11:51,397 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0bd51a8e185e8e5398d32c37ac921aac/cf/d0a71ed3300a478fae4ce11eaa4b98c5, entries=1, sequenceid=5, filesize=4.7 K 2023-07-18 10:11:51,398 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 0bd51a8e185e8e5398d32c37ac921aac in 461ms, sequenceid=5, compaction requested=false 2023-07-18 10:11:51,406 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0bd51a8e185e8e5398d32c37ac921aac/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-18 10:11:51,407 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 10:11:51,407 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689675110083.0bd51a8e185e8e5398d32c37ac921aac. 2023-07-18 10:11:51,407 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0bd51a8e185e8e5398d32c37ac921aac: 2023-07-18 10:11:51,409 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0bd51a8e185e8e5398d32c37ac921aac 2023-07-18 10:11:51,410 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=0bd51a8e185e8e5398d32c37ac921aac, regionState=CLOSED 2023-07-18 10:11:51,410 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689675110083.0bd51a8e185e8e5398d32c37ac921aac.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689675111410"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689675111410"}]},"ts":"1689675111410"} 2023-07-18 10:11:51,415 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=73 2023-07-18 10:11:51,415 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 0bd51a8e185e8e5398d32c37ac921aac, server=jenkins-hbase4.apache.org,34221,1689675027589 in 631 msec 2023-07-18 10:11:51,417 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=71 2023-07-18 10:11:51,417 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0bd51a8e185e8e5398d32c37ac921aac, UNASSIGN in 643 msec 2023-07-18 10:11:51,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-18 10:11:51,889 DEBUG [PEWorker-5] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/18175fafb433a5bb62a5d4510a5da264/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-18 10:11:51,897 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689675110083.8ad6a328546bcebe5eca9cc995a7ff1b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-18 10:11:51,897 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689675110083.0bd51a8e185e8e5398d32c37ac921aac.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-18 10:11:51,897 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689675110084.18175fafb433a5bb62a5d4510a5da264.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-18 10:11:52,001 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=18175fafb433a5bb62a5d4510a5da264, ASSIGN}] 2023-07-18 10:11:52,002 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=18175fafb433a5bb62a5d4510a5da264, ASSIGN 2023-07-18 10:11:52,007 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=18175fafb433a5bb62a5d4510a5da264, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,33757,1689675027667; forceNewPlan=false, retain=false 2023-07-18 10:11:52,043 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689675035639_0004_000001 (auth:SIMPLE) 2023-07-18 10:11:52,157 INFO [jenkins-hbase4:46557] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-18 10:11:52,159 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=18175fafb433a5bb62a5d4510a5da264, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:52,160 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689675110084.18175fafb433a5bb62a5d4510a5da264.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689675112159"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689675112159"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689675112159"}]},"ts":"1689675112159"} 2023-07-18 10:11:52,162 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 18175fafb433a5bb62a5d4510a5da264, server=jenkins-hbase4.apache.org,33757,1689675027667}] 2023-07-18 10:11:52,318 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689675110084.18175fafb433a5bb62a5d4510a5da264. 2023-07-18 10:11:52,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 18175fafb433a5bb62a5d4510a5da264, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689675110084.18175fafb433a5bb62a5d4510a5da264.', STARTKEY => '', ENDKEY => ''} 2023-07-18 10:11:52,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689675110084.18175fafb433a5bb62a5d4510a5da264. service=AccessControlService 2023-07-18 10:11:52,318 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 10:11:52,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 18175fafb433a5bb62a5d4510a5da264 2023-07-18 10:11:52,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689675110084.18175fafb433a5bb62a5d4510a5da264.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:11:52,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 18175fafb433a5bb62a5d4510a5da264 2023-07-18 10:11:52,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 18175fafb433a5bb62a5d4510a5da264 2023-07-18 10:11:52,322 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/18175fafb433a5bb62a5d4510a5da264/.regioninfo 2023-07-18 10:11:52,347 INFO [StoreOpener-18175fafb433a5bb62a5d4510a5da264-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 18175fafb433a5bb62a5d4510a5da264 2023-07-18 10:11:52,348 DEBUG [StoreOpener-18175fafb433a5bb62a5d4510a5da264-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/18175fafb433a5bb62a5d4510a5da264/cf 2023-07-18 10:11:52,348 DEBUG [StoreOpener-18175fafb433a5bb62a5d4510a5da264-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/18175fafb433a5bb62a5d4510a5da264/cf 2023-07-18 10:11:52,349 INFO [StoreOpener-18175fafb433a5bb62a5d4510a5da264-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 18175fafb433a5bb62a5d4510a5da264 columnFamilyName cf 2023-07-18 10:11:52,379 DEBUG [StoreOpener-18175fafb433a5bb62a5d4510a5da264-1] regionserver.HStore(539): loaded hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/18175fafb433a5bb62a5d4510a5da264/cf/4e9042cc993e431ea07b48401863f484.8ad6a328546bcebe5eca9cc995a7ff1b->hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8ad6a328546bcebe5eca9cc995a7ff1b/cf/4e9042cc993e431ea07b48401863f484-top 2023-07-18 10:11:52,390 DEBUG [StoreOpener-18175fafb433a5bb62a5d4510a5da264-1] regionserver.HStore(539): loaded hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/18175fafb433a5bb62a5d4510a5da264/cf/d0a71ed3300a478fae4ce11eaa4b98c5.0bd51a8e185e8e5398d32c37ac921aac->hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0bd51a8e185e8e5398d32c37ac921aac/cf/d0a71ed3300a478fae4ce11eaa4b98c5-top 2023-07-18 10:11:52,391 INFO [StoreOpener-18175fafb433a5bb62a5d4510a5da264-1] regionserver.HStore(310): Store=18175fafb433a5bb62a5d4510a5da264/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 10:11:52,392 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/18175fafb433a5bb62a5d4510a5da264 2023-07-18 10:11:52,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/18175fafb433a5bb62a5d4510a5da264 2023-07-18 10:11:52,397 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 18175fafb433a5bb62a5d4510a5da264 2023-07-18 10:11:52,398 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 18175fafb433a5bb62a5d4510a5da264; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74115170, jitterRate=0.104402095079422}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 10:11:52,399 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 18175fafb433a5bb62a5d4510a5da264: 2023-07-18 10:11:52,399 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689675110084.18175fafb433a5bb62a5d4510a5da264., pid=77, masterSystemTime=1689675112314 2023-07-18 10:11:52,400 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689675110084.18175fafb433a5bb62a5d4510a5da264.,because compaction is disabled. 2023-07-18 10:11:52,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689675110084.18175fafb433a5bb62a5d4510a5da264. 2023-07-18 10:11:52,403 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689675110084.18175fafb433a5bb62a5d4510a5da264. 2023-07-18 10:11:52,404 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=18175fafb433a5bb62a5d4510a5da264, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:52,404 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689675110084.18175fafb433a5bb62a5d4510a5da264.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689675112403"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689675112403"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689675112403"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689675112403"}]},"ts":"1689675112403"} 2023-07-18 10:11:52,407 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-18 10:11:52,407 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 18175fafb433a5bb62a5d4510a5da264, server=jenkins-hbase4.apache.org,33757,1689675027667 in 244 msec 2023-07-18 10:11:52,409 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-18 10:11:52,410 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=18175fafb433a5bb62a5d4510a5da264, ASSIGN in 406 msec 2023-07-18 10:11:52,411 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[8ad6a328546bcebe5eca9cc995a7ff1b, 0bd51a8e185e8e5398d32c37ac921aac], force=true in 1.6800 sec 2023-07-18 10:11:52,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-18 10:11:52,849 INFO [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-18 10:11:52,850 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-18 10:11:52,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689675112850 (current time:1689675112850). 2023-07-18 10:11:52,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 10:11:52,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] zookeeper.ReadOnlyZKClient(139): Connect 0x13d0b505 to 127.0.0.1:56089 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 10:11:52,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4a58d812, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 10:11:52,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:11:52,890 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38064, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:11:52,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x13d0b505 to 127.0.0.1:56089 2023-07-18 10:11:52,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 10:11:52,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] zookeeper.ReadOnlyZKClient(139): Connect 0x6cca5bdc to 127.0.0.1:56089 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 10:11:52,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7aa4a3dd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 10:11:52,931 DEBUG [hconnection-0x76306cd3-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:11:52,940 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38076, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:11:52,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:11:52,951 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39022, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:11:52,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6cca5bdc to 127.0.0.1:56089 2023-07-18 10:11:52,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 10:11:52,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-18 10:11:52,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 10:11:52,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-18 10:11:52,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-18 10:11:52,959 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-18 10:11:52,960 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689675712960 2023-07-18 10:11:52,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-18 10:11:52,960 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:52,966 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 10:11:52,966 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 10:11:52,968 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-18 10:11:52,969 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-18 10:11:52,975 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 12 msec 2023-07-18 10:11:52,976 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-18 10:11:52,977 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689675712977 2023-07-18 10:11:53,022 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:53,023 INFO [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-18 10:11:53,023 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:11:53,024 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-18 10:11:53,024 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-18 10:11:53,025 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:53,025 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:53,026 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:11:53,026 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:11:53,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:11:53,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:11:53,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:11:53,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:11:53,026 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:53,026 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:11:53,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:11:53,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:11:53,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:53,027 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:53,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:53,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:53,028 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 10:11:53,028 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:53,028 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:53,028 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:53,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-18 10:11:53,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:53,029 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-18 10:11:53,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-18 10:11:53,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:53,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-18 10:11:53,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:53,029 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-18 10:11:53,029 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-18 10:11:53,034 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:53,035 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:53,035 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-18 10:11:53,035 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-18 10:11:53,035 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:11:53,035 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:11:53,048 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-18 10:11:53,048 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:53,048 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-18 10:11:53,048 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-18 10:11:53,048 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:11:53,048 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-18 10:11:53,048 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-18 10:11:53,048 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34221,1689675027589' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-18 10:11:53,048 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40089,1689675027524' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-18 10:11:53,053 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-18 10:11:53,053 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-18 10:11:53,053 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33757,1689675027667' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-18 10:11:53,056 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:53,056 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:53,056 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:53,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:53,056 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:53,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:11:53,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:11:53,057 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:53,057 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:53,057 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:11:53,057 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:53,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:11:53,057 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:11:53,057 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:11:53,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:11:53,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:53,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:53,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:53,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:53,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:11:53,060 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33757,1689675027667' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-18 10:11:53,060 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2514e381[Count = 0] remaining members to acquire global barrier 2023-07-18 10:11:53,060 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-18 10:11:53,060 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:53,063 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:53,063 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:53,063 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:53,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:53,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:53,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:53,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:53,063 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-18 10:11:53,063 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:53,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:53,063 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 10:11:53,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:53,063 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-18 10:11:53,064 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-18 10:11:53,064 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-18 10:11:53,064 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,34221,1689675027589' in zk 2023-07-18 10:11:53,064 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-18 10:11:53,064 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,40089,1689675027524' in zk 2023-07-18 10:11:53,065 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-18 10:11:53,065 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:11:53,065 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-18 10:11:53,066 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 10:11:53,066 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-18 10:11:53,066 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:11:53,066 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-18 10:11:53,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-18 10:11:53,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-18 10:11:53,067 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 10:11:53,068 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 10:11:53,068 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 10:11:53,068 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689675110084.18175fafb433a5bb62a5d4510a5da264. 2023-07-18 10:11:53,068 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689675110084.18175fafb433a5bb62a5d4510a5da264. started... 2023-07-18 10:11:53,074 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 18175fafb433a5bb62a5d4510a5da264: 2023-07-18 10:11:53,074 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689675110084.18175fafb433a5bb62a5d4510a5da264.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:53,074 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 10:11:53,075 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/18175fafb433a5bb62a5d4510a5da264/cf/4e9042cc993e431ea07b48401863f484.8ad6a328546bcebe5eca9cc995a7ff1b->hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8ad6a328546bcebe5eca9cc995a7ff1b/cf/4e9042cc993e431ea07b48401863f484-top, hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/18175fafb433a5bb62a5d4510a5da264/cf/d0a71ed3300a478fae4ce11eaa4b98c5.0bd51a8e185e8e5398d32c37ac921aac->hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0bd51a8e185e8e5398d32c37ac921aac/cf/d0a71ed3300a478fae4ce11eaa4b98c5-top] hfiles 2023-07-18 10:11:53,075 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/18175fafb433a5bb62a5d4510a5da264/cf/4e9042cc993e431ea07b48401863f484.8ad6a328546bcebe5eca9cc995a7ff1b for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:53,083 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/18175fafb433a5bb62a5d4510a5da264/cf/d0a71ed3300a478fae4ce11eaa4b98c5.0bd51a8e185e8e5398d32c37ac921aac for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:53,130 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689675110084.18175fafb433a5bb62a5d4510a5da264. completed. 2023-07-18 10:11:53,130 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689675110084.18175fafb433a5bb62a5d4510a5da264. 2023-07-18 10:11:53,130 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 10:11:53,130 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 10:11:53,130 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:53,130 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-18 10:11:53,130 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,33757,1689675027667' in zk 2023-07-18 10:11:53,143 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:53,143 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-18 10:11:53,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:53,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:11:53,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:11:53,143 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:11:53,143 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-18 10:11:53,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:11:53,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:11:53,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:53,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:53,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:53,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:53,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:11:53,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:53,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:53,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:53,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:53,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,33757,1689675027667': 2023-07-18 10:11:53,150 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33757,1689675027667' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-18 10:11:53,150 INFO [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-18 10:11:53,150 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 10:11:53,150 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 10:11:53,150 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:53,150 INFO [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 10:11:53,152 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:53,152 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:53,152 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:53,152 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:53,152 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:53,152 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:53,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:53,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:11:53,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:11:53,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:11:53,153 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:53,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:53,152 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:11:53,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:53,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:53,154 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:11:53,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:11:53,152 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:53,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:53,152 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:11:53,152 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:11:53,154 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:53,154 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:11:53,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:11:53,154 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:11:53,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:11:53,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:53,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:11:53,155 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:53,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:53,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:53,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:53,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:53,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:53,158 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:53,158 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:53,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:53,159 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:53,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:11:53,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:53,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:53,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:53,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:53,174 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:11:53,176 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:11:53,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:11:53,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:11:53,177 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:53,177 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:53,177 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:53,177 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:53,177 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:53,177 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:11:53,177 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:11:53,177 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:11:53,177 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:11:53,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:11:53,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:11:53,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:11:53,177 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:11:53,177 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:53,177 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:53,178 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:53,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:11:53,178 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:11:53,177 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:11:53,178 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:11:53,178 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:53,178 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:53,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:11:53,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:11:53,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:11:53,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:11:53,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:11:53,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:11:53,180 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:53,268 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 10:11:53,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-18 10:11:53,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-18 10:11:53,270 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-18 10:11:53,277 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:53,365 WARN [DataStreamer for file /user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-07-18 10:11:53,410 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-18 10:11:53,411 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:53,411 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:53,412 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689675112960Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689675113178 (+218 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689675113178Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689675113192 (+14 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689675113252 (+60 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689675113410 (+158 ms) 2023-07-18 10:11:53,415 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-18 10:11:53,418 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 449 msec 2023-07-18 10:11:53,570 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 10:11:53,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-18 10:11:53,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 10:11:53,572 INFO [Listener at jenkins-hbase4.apache.org/42677] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/export-test/export-1689675113572 2023-07-18 10:11:53,572 INFO [Listener at jenkins-hbase4.apache.org/42677] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35953, tgtDir=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/export-test/export-1689675113572, rawTgtDir=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/export-test/export-1689675113572, srcFsUri=hdfs://localhost:35953, srcDir=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336 2023-07-18 10:11:53,605 DEBUG [Listener at jenkins-hbase4.apache.org/42677] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35953, inputRoot=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336 2023-07-18 10:11:53,605 DEBUG [Listener at jenkins-hbase4.apache.org/42677] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_197952803_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/export-test/export-1689675113572, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/export-test/export-1689675113572/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:53,605 INFO [Listener at jenkins-hbase4.apache.org/42677] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35953, inputRoot=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336, snapshotDir=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-18 10:11:53,617 INFO [Listener at jenkins-hbase4.apache.org/42677] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/export-test/export-1689675113572/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:53,679 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-18 10:11:53,738 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:53,739 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:53,739 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:53,740 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:53,740 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:53,741 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:53,741 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:53,888 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/hadoop-5250897731030436436.jar 2023-07-18 10:11:53,889 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:53,890 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:53,890 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:53,891 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:53,891 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:53,892 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:53,893 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-18 10:11:53,893 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-18 10:11:53,894 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-18 10:11:53,895 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-18 10:11:53,896 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-18 10:11:53,896 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-18 10:11:53,897 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-18 10:11:53,897 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-18 10:11:53,898 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-18 10:11:53,899 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-18 10:11:53,899 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 10:11:53,900 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 10:11:53,900 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 10:11:53,900 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 10:11:53,901 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 10:11:53,901 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 10:11:53,902 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 10:11:55,161 WARN [Listener at jenkins-hbase4.apache.org/42677] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-18 10:11:55,166 INFO [Listener at jenkins-hbase4.apache.org/42677] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-18 10:11:55,168 DEBUG [Listener at jenkins-hbase4.apache.org/42677] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-18 10:11:55,285 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 10:11:55,285 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 10:11:56,068 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689675035639_0005_000001 (auth:SIMPLE) 2023-07-18 10:12:02,317 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689675035639_0005_000001 (auth:SIMPLE) 2023-07-18 10:12:04,736 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689675035639_0005_000001 (auth:SIMPLE) 2023-07-18 10:12:08,412 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689675035639_0005_000001 (auth:SIMPLE) 2023-07-18 10:12:09,496 INFO [Listener at jenkins-hbase4.apache.org/42677] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-18 10:12:09,506 INFO [Listener at jenkins-hbase4.apache.org/42677] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-18 10:12:09,518 INFO [Listener at jenkins-hbase4.apache.org/42677] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:12:09,518 INFO [Listener at jenkins-hbase4.apache.org/42677] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-18 10:12:09,519 INFO [Listener at jenkins-hbase4.apache.org/42677] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-18 10:12:09,519 DEBUG [Listener at jenkins-hbase4.apache.org/42677] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1314676217_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:12:09,520 DEBUG [Listener at jenkins-hbase4.apache.org/42677] snapshot.TestExportSnapshot(367): hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-18 10:12:09,520 DEBUG [Listener at jenkins-hbase4.apache.org/42677] snapshot.TestExportSnapshot(367): hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-18 10:12:09,520 DEBUG [Listener at jenkins-hbase4.apache.org/42677] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1314676217_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/export-test/export-1689675113572/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/export-test/export-1689675113572/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:12:09,520 DEBUG [Listener at jenkins-hbase4.apache.org/42677] snapshot.TestExportSnapshot(367): hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/export-test/export-1689675113572/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-18 10:12:09,520 DEBUG [Listener at jenkins-hbase4.apache.org/42677] snapshot.TestExportSnapshot(367): hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/export-test/export-1689675113572/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-18 10:12:09,528 INFO [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:12:09,528 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:12:09,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:12:09,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-18 10:12:09,532 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689675129532"}]},"ts":"1689675129532"} 2023-07-18 10:12:09,534 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-18 10:12:09,535 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-18 10:12:09,536 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=18175fafb433a5bb62a5d4510a5da264, UNASSIGN}] 2023-07-18 10:12:09,538 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=18175fafb433a5bb62a5d4510a5da264, UNASSIGN 2023-07-18 10:12:09,539 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=18175fafb433a5bb62a5d4510a5da264, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:09,539 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689675110084.18175fafb433a5bb62a5d4510a5da264.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689675129539"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689675129539"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689675129539"}]},"ts":"1689675129539"} 2023-07-18 10:12:09,540 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 18175fafb433a5bb62a5d4510a5da264, server=jenkins-hbase4.apache.org,33757,1689675027667}] 2023-07-18 10:12:09,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-18 10:12:09,692 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 18175fafb433a5bb62a5d4510a5da264 2023-07-18 10:12:09,692 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 18175fafb433a5bb62a5d4510a5da264, disabling compactions & flushes 2023-07-18 10:12:09,692 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689675110084.18175fafb433a5bb62a5d4510a5da264. 2023-07-18 10:12:09,692 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689675110084.18175fafb433a5bb62a5d4510a5da264. 2023-07-18 10:12:09,692 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689675110084.18175fafb433a5bb62a5d4510a5da264. after waiting 0 ms 2023-07-18 10:12:09,692 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689675110084.18175fafb433a5bb62a5d4510a5da264. 2023-07-18 10:12:09,704 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/18175fafb433a5bb62a5d4510a5da264/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-18 10:12:09,704 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 10:12:09,711 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689675110084.18175fafb433a5bb62a5d4510a5da264. 2023-07-18 10:12:09,711 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 18175fafb433a5bb62a5d4510a5da264: 2023-07-18 10:12:09,713 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 18175fafb433a5bb62a5d4510a5da264 2023-07-18 10:12:09,714 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=18175fafb433a5bb62a5d4510a5da264, regionState=CLOSED 2023-07-18 10:12:09,714 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689675110084.18175fafb433a5bb62a5d4510a5da264.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689675129714"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689675129714"}]},"ts":"1689675129714"} 2023-07-18 10:12:09,723 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-18 10:12:09,723 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 18175fafb433a5bb62a5d4510a5da264, server=jenkins-hbase4.apache.org,33757,1689675027667 in 176 msec 2023-07-18 10:12:09,726 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-18 10:12:09,726 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=18175fafb433a5bb62a5d4510a5da264, UNASSIGN in 187 msec 2023-07-18 10:12:09,726 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689675129726"}]},"ts":"1689675129726"} 2023-07-18 10:12:09,731 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-18 10:12:09,734 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-18 10:12:09,746 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 216 msec 2023-07-18 10:12:09,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-18 10:12:09,835 INFO [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-18 10:12:09,836 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:12:09,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:12:09,840 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:12:09,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:12:09,841 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:12:09,843 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34221] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:12:09,845 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/18175fafb433a5bb62a5d4510a5da264 2023-07-18 10:12:09,846 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0bd51a8e185e8e5398d32c37ac921aac 2023-07-18 10:12:09,847 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8ad6a328546bcebe5eca9cc995a7ff1b 2023-07-18 10:12:09,848 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/18175fafb433a5bb62a5d4510a5da264/cf, FileablePath, hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/18175fafb433a5bb62a5d4510a5da264/recovered.edits] 2023-07-18 10:12:09,849 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0bd51a8e185e8e5398d32c37ac921aac/cf, FileablePath, hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0bd51a8e185e8e5398d32c37ac921aac/recovered.edits] 2023-07-18 10:12:09,851 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8ad6a328546bcebe5eca9cc995a7ff1b/cf, FileablePath, hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8ad6a328546bcebe5eca9cc995a7ff1b/recovered.edits] 2023-07-18 10:12:09,852 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:12:09,852 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-18 10:12:09,853 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:12:09,854 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-18 10:12:09,855 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:12:09,855 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:12:09,855 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:12:09,856 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:12:09,856 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:12:09,856 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:12:09,856 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:12:09,856 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-18 10:12:09,856 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-18 10:12:09,856 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:12:09,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-18 10:12:09,857 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 10:12:09,857 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 10:12:09,858 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-18 10:12:09,858 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-18 10:12:09,859 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 10:12:09,860 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 10:12:09,860 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0bd51a8e185e8e5398d32c37ac921aac/cf/d0a71ed3300a478fae4ce11eaa4b98c5 to hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0bd51a8e185e8e5398d32c37ac921aac/cf/d0a71ed3300a478fae4ce11eaa4b98c5 2023-07-18 10:12:09,861 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/18175fafb433a5bb62a5d4510a5da264/cf/4e9042cc993e431ea07b48401863f484.8ad6a328546bcebe5eca9cc995a7ff1b to hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/18175fafb433a5bb62a5d4510a5da264/cf/4e9042cc993e431ea07b48401863f484.8ad6a328546bcebe5eca9cc995a7ff1b 2023-07-18 10:12:09,866 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8ad6a328546bcebe5eca9cc995a7ff1b/cf/4e9042cc993e431ea07b48401863f484 to hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8ad6a328546bcebe5eca9cc995a7ff1b/cf/4e9042cc993e431ea07b48401863f484 2023-07-18 10:12:09,866 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0bd51a8e185e8e5398d32c37ac921aac/recovered.edits/8.seqid to hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0bd51a8e185e8e5398d32c37ac921aac/recovered.edits/8.seqid 2023-07-18 10:12:09,867 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0bd51a8e185e8e5398d32c37ac921aac 2023-07-18 10:12:09,871 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8ad6a328546bcebe5eca9cc995a7ff1b/recovered.edits/8.seqid to hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8ad6a328546bcebe5eca9cc995a7ff1b/recovered.edits/8.seqid 2023-07-18 10:12:09,872 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8ad6a328546bcebe5eca9cc995a7ff1b 2023-07-18 10:12:09,877 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/18175fafb433a5bb62a5d4510a5da264/cf/d0a71ed3300a478fae4ce11eaa4b98c5.0bd51a8e185e8e5398d32c37ac921aac to hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/18175fafb433a5bb62a5d4510a5da264/cf/d0a71ed3300a478fae4ce11eaa4b98c5.0bd51a8e185e8e5398d32c37ac921aac 2023-07-18 10:12:09,881 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/18175fafb433a5bb62a5d4510a5da264/recovered.edits/12.seqid to hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/18175fafb433a5bb62a5d4510a5da264/recovered.edits/12.seqid 2023-07-18 10:12:09,882 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/18175fafb433a5bb62a5d4510a5da264 2023-07-18 10:12:09,882 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-18 10:12:09,884 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:12:09,887 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-18 10:12:09,889 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-18 10:12:09,890 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:12:09,890 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-18 10:12:09,890 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689675110084.18175fafb433a5bb62a5d4510a5da264.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689675129890"}]},"ts":"9223372036854775807"} 2023-07-18 10:12:09,891 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-18 10:12:09,892 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 18175fafb433a5bb62a5d4510a5da264, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689675110084.18175fafb433a5bb62a5d4510a5da264.', STARTKEY => '', ENDKEY => ''}] 2023-07-18 10:12:09,892 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-18 10:12:09,892 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689675129892"}]},"ts":"9223372036854775807"} 2023-07-18 10:12:09,893 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-18 10:12:09,895 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:12:09,899 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 59 msec 2023-07-18 10:12:09,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-18 10:12:09,958 INFO [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-18 10:12:09,959 INFO [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 10:12:09,960 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 10:12:09,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 10:12:09,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-18 10:12:09,967 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689675129967"}]},"ts":"1689675129967"} 2023-07-18 10:12:09,970 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-18 10:12:09,973 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-18 10:12:09,974 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c5c8d1378e8de4b01a65e3a5559754dd, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=61272b39ea7023414fcd976c4b595f1b, UNASSIGN}] 2023-07-18 10:12:09,975 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c5c8d1378e8de4b01a65e3a5559754dd, UNASSIGN 2023-07-18 10:12:09,975 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=c5c8d1378e8de4b01a65e3a5559754dd, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:12:09,977 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689675108311.c5c8d1378e8de4b01a65e3a5559754dd.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689675129975"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689675129975"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689675129975"}]},"ts":"1689675129975"} 2023-07-18 10:12:09,978 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=61272b39ea7023414fcd976c4b595f1b, UNASSIGN 2023-07-18 10:12:09,979 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=61272b39ea7023414fcd976c4b595f1b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:09,979 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689675108311.61272b39ea7023414fcd976c4b595f1b.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689675129979"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689675129979"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689675129979"}]},"ts":"1689675129979"} 2023-07-18 10:12:09,980 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure c5c8d1378e8de4b01a65e3a5559754dd, server=jenkins-hbase4.apache.org,40089,1689675027524}] 2023-07-18 10:12:09,981 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 61272b39ea7023414fcd976c4b595f1b, server=jenkins-hbase4.apache.org,33757,1689675027667}] 2023-07-18 10:12:10,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-18 10:12:10,132 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c5c8d1378e8de4b01a65e3a5559754dd 2023-07-18 10:12:10,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c5c8d1378e8de4b01a65e3a5559754dd, disabling compactions & flushes 2023-07-18 10:12:10,132 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689675108311.c5c8d1378e8de4b01a65e3a5559754dd. 2023-07-18 10:12:10,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689675108311.c5c8d1378e8de4b01a65e3a5559754dd. 2023-07-18 10:12:10,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689675108311.c5c8d1378e8de4b01a65e3a5559754dd. after waiting 0 ms 2023-07-18 10:12:10,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689675108311.c5c8d1378e8de4b01a65e3a5559754dd. 2023-07-18 10:12:10,133 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 61272b39ea7023414fcd976c4b595f1b 2023-07-18 10:12:10,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 61272b39ea7023414fcd976c4b595f1b, disabling compactions & flushes 2023-07-18 10:12:10,133 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689675108311.61272b39ea7023414fcd976c4b595f1b. 2023-07-18 10:12:10,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689675108311.61272b39ea7023414fcd976c4b595f1b. 2023-07-18 10:12:10,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689675108311.61272b39ea7023414fcd976c4b595f1b. after waiting 0 ms 2023-07-18 10:12:10,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689675108311.61272b39ea7023414fcd976c4b595f1b. 2023-07-18 10:12:10,158 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithMergeRegion/61272b39ea7023414fcd976c4b595f1b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 10:12:10,158 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 10:12:10,160 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689675108311.61272b39ea7023414fcd976c4b595f1b. 2023-07-18 10:12:10,160 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithMergeRegion/c5c8d1378e8de4b01a65e3a5559754dd/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 10:12:10,160 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 61272b39ea7023414fcd976c4b595f1b: 2023-07-18 10:12:10,161 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 10:12:10,162 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689675108311.c5c8d1378e8de4b01a65e3a5559754dd. 2023-07-18 10:12:10,162 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c5c8d1378e8de4b01a65e3a5559754dd: 2023-07-18 10:12:10,164 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 61272b39ea7023414fcd976c4b595f1b 2023-07-18 10:12:10,165 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=61272b39ea7023414fcd976c4b595f1b, regionState=CLOSED 2023-07-18 10:12:10,165 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689675108311.61272b39ea7023414fcd976c4b595f1b.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689675130164"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689675130164"}]},"ts":"1689675130164"} 2023-07-18 10:12:10,165 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c5c8d1378e8de4b01a65e3a5559754dd 2023-07-18 10:12:10,165 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=c5c8d1378e8de4b01a65e3a5559754dd, regionState=CLOSED 2023-07-18 10:12:10,165 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689675108311.c5c8d1378e8de4b01a65e3a5559754dd.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689675130165"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689675130165"}]},"ts":"1689675130165"} 2023-07-18 10:12:10,168 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=86 2023-07-18 10:12:10,168 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 61272b39ea7023414fcd976c4b595f1b, server=jenkins-hbase4.apache.org,33757,1689675027667 in 185 msec 2023-07-18 10:12:10,169 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=85 2023-07-18 10:12:10,169 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure c5c8d1378e8de4b01a65e3a5559754dd, server=jenkins-hbase4.apache.org,40089,1689675027524 in 187 msec 2023-07-18 10:12:10,169 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=61272b39ea7023414fcd976c4b595f1b, UNASSIGN in 194 msec 2023-07-18 10:12:10,176 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=84 2023-07-18 10:12:10,177 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c5c8d1378e8de4b01a65e3a5559754dd, UNASSIGN in 195 msec 2023-07-18 10:12:10,178 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689675130178"}]},"ts":"1689675130178"} 2023-07-18 10:12:10,180 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-18 10:12:10,182 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-18 10:12:10,187 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 225 msec 2023-07-18 10:12:10,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-18 10:12:10,269 INFO [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-18 10:12:10,269 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 10:12:10,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 10:12:10,273 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 10:12:10,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 10:12:10,274 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 10:12:10,275 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34221] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 10:12:10,280 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c5c8d1378e8de4b01a65e3a5559754dd 2023-07-18 10:12:10,280 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/61272b39ea7023414fcd976c4b595f1b 2023-07-18 10:12:10,282 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c5c8d1378e8de4b01a65e3a5559754dd/cf, FileablePath, hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c5c8d1378e8de4b01a65e3a5559754dd/recovered.edits] 2023-07-18 10:12:10,282 DEBUG [HFileArchiver-16] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/61272b39ea7023414fcd976c4b595f1b/cf, FileablePath, hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/61272b39ea7023414fcd976c4b595f1b/recovered.edits] 2023-07-18 10:12:10,283 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 10:12:10,283 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 10:12:10,283 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 10:12:10,284 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-18 10:12:10,284 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-18 10:12:10,284 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-18 10:12:10,284 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 10:12:10,285 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:12:10,285 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 10:12:10,285 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:12:10,285 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data null 2023-07-18 10:12:10,285 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-18 10:12:10,285 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 10:12:10,285 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:12:10,285 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 10:12:10,285 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:12:10,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-18 10:12:10,289 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c5c8d1378e8de4b01a65e3a5559754dd/cf/5133c223ddeb4f2fa13b7e5ec8ea8126 to hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/c5c8d1378e8de4b01a65e3a5559754dd/cf/5133c223ddeb4f2fa13b7e5ec8ea8126 2023-07-18 10:12:10,290 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/61272b39ea7023414fcd976c4b595f1b/cf/9b020f9e23e043b19414f86d72e20aa2 to hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/61272b39ea7023414fcd976c4b595f1b/cf/9b020f9e23e043b19414f86d72e20aa2 2023-07-18 10:12:10,293 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c5c8d1378e8de4b01a65e3a5559754dd/recovered.edits/9.seqid to hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/c5c8d1378e8de4b01a65e3a5559754dd/recovered.edits/9.seqid 2023-07-18 10:12:10,293 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/61272b39ea7023414fcd976c4b595f1b/recovered.edits/9.seqid to hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/61272b39ea7023414fcd976c4b595f1b/recovered.edits/9.seqid 2023-07-18 10:12:10,293 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c5c8d1378e8de4b01a65e3a5559754dd 2023-07-18 10:12:10,294 DEBUG [HFileArchiver-16] backup.HFileArchiver(596): Deleted hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/61272b39ea7023414fcd976c4b595f1b 2023-07-18 10:12:10,294 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-18 10:12:10,296 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 10:12:10,300 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-18 10:12:10,303 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-18 10:12:10,304 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 10:12:10,304 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-18 10:12:10,304 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689675108311.c5c8d1378e8de4b01a65e3a5559754dd.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689675130304"}]},"ts":"9223372036854775807"} 2023-07-18 10:12:10,304 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689675108311.61272b39ea7023414fcd976c4b595f1b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689675130304"}]},"ts":"9223372036854775807"} 2023-07-18 10:12:10,306 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-18 10:12:10,306 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => c5c8d1378e8de4b01a65e3a5559754dd, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689675108311.c5c8d1378e8de4b01a65e3a5559754dd.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 61272b39ea7023414fcd976c4b595f1b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689675108311.61272b39ea7023414fcd976c4b595f1b.', STARTKEY => '1', ENDKEY => ''}] 2023-07-18 10:12:10,306 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-18 10:12:10,306 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689675130306"}]},"ts":"9223372036854775807"} 2023-07-18 10:12:10,308 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-18 10:12:10,310 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 10:12:10,317 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 40 msec 2023-07-18 10:12:10,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-18 10:12:10,388 INFO [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-18 10:12:10,400 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-18 10:12:10,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:12:10,404 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-18 10:12:10,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:12:10,408 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-18 10:12:10,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:12:10,446 INFO [Listener at jenkins-hbase4.apache.org/42677] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=758 (was 747) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1314676217_17 at /127.0.0.1:54138 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1314676217_17 at /127.0.0.1:50652 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x56f36059-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x56f36059-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-991348121_1 at /127.0.0.1:40582 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x56f36059-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x56f36059-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1314676217_17 at /127.0.0.1:38010 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x56f36059-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (274932937) connection to jenkins-hbase4.apache.org/172.31.14.131:36635 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x56f36059-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3946 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) - Thread LEAK? -, OpenFileDescriptor=903 (was 890) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=488 (was 425) - SystemLoadAverage LEAK? -, ProcessCount=184 (was 184), AvailableMemoryMB=2272 (was 2325) 2023-07-18 10:12:10,447 WARN [Listener at jenkins-hbase4.apache.org/42677] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-07-18 10:12:10,470 INFO [Listener at jenkins-hbase4.apache.org/42677] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=758, OpenFileDescriptor=903, MaxFileDescriptor=60000, SystemLoadAverage=488, ProcessCount=184, AvailableMemoryMB=2271 2023-07-18 10:12:10,470 WARN [Listener at jenkins-hbase4.apache.org/42677] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-07-18 10:12:10,472 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-18 10:12:10,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-18 10:12:10,476 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 10:12:10,476 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-18 10:12:10,477 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 10:12:10,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-18 10:12:10,480 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testEmptyExportFileSystemState/6ff6715aec78db4b99cdb9ac6dd8fc9f 2023-07-18 10:12:10,480 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testEmptyExportFileSystemState/61bad78390ec42260746f4a4ea413ab6 2023-07-18 10:12:10,481 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testEmptyExportFileSystemState/6ff6715aec78db4b99cdb9ac6dd8fc9f empty. 2023-07-18 10:12:10,481 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testEmptyExportFileSystemState/61bad78390ec42260746f4a4ea413ab6 empty. 2023-07-18 10:12:10,481 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testEmptyExportFileSystemState/6ff6715aec78db4b99cdb9ac6dd8fc9f 2023-07-18 10:12:10,481 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testEmptyExportFileSystemState/61bad78390ec42260746f4a4ea413ab6 2023-07-18 10:12:10,481 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-18 10:12:10,493 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-18 10:12:10,495 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 61bad78390ec42260746f4a4ea413ab6, NAME => 'testtb-testEmptyExportFileSystemState,1,1689675130472.61bad78390ec42260746f4a4ea413ab6.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp 2023-07-18 10:12:10,495 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6ff6715aec78db4b99cdb9ac6dd8fc9f, NAME => 'testtb-testEmptyExportFileSystemState,,1689675130472.6ff6715aec78db4b99cdb9ac6dd8fc9f.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp 2023-07-18 10:12:10,528 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689675130472.6ff6715aec78db4b99cdb9ac6dd8fc9f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:12:10,528 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 6ff6715aec78db4b99cdb9ac6dd8fc9f, disabling compactions & flushes 2023-07-18 10:12:10,528 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689675130472.6ff6715aec78db4b99cdb9ac6dd8fc9f. 2023-07-18 10:12:10,528 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689675130472.6ff6715aec78db4b99cdb9ac6dd8fc9f. 2023-07-18 10:12:10,529 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689675130472.6ff6715aec78db4b99cdb9ac6dd8fc9f. after waiting 0 ms 2023-07-18 10:12:10,529 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689675130472.6ff6715aec78db4b99cdb9ac6dd8fc9f. 2023-07-18 10:12:10,529 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689675130472.6ff6715aec78db4b99cdb9ac6dd8fc9f. 2023-07-18 10:12:10,529 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 6ff6715aec78db4b99cdb9ac6dd8fc9f: 2023-07-18 10:12:10,530 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689675130472.61bad78390ec42260746f4a4ea413ab6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:12:10,530 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 61bad78390ec42260746f4a4ea413ab6, disabling compactions & flushes 2023-07-18 10:12:10,530 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689675130472.61bad78390ec42260746f4a4ea413ab6. 2023-07-18 10:12:10,530 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689675130472.61bad78390ec42260746f4a4ea413ab6. 2023-07-18 10:12:10,530 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689675130472.61bad78390ec42260746f4a4ea413ab6. after waiting 0 ms 2023-07-18 10:12:10,530 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689675130472.61bad78390ec42260746f4a4ea413ab6. 2023-07-18 10:12:10,530 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689675130472.61bad78390ec42260746f4a4ea413ab6. 2023-07-18 10:12:10,530 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 61bad78390ec42260746f4a4ea413ab6: 2023-07-18 10:12:10,532 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 10:12:10,533 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689675130472.6ff6715aec78db4b99cdb9ac6dd8fc9f.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689675130533"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689675130533"}]},"ts":"1689675130533"} 2023-07-18 10:12:10,533 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689675130472.61bad78390ec42260746f4a4ea413ab6.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689675130533"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689675130533"}]},"ts":"1689675130533"} 2023-07-18 10:12:10,535 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-18 10:12:10,536 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 10:12:10,536 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689675130536"}]},"ts":"1689675130536"} 2023-07-18 10:12:10,538 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-18 10:12:10,540 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 10:12:10,542 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 10:12:10,542 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 10:12:10,542 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 10:12:10,542 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 10:12:10,542 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6ff6715aec78db4b99cdb9ac6dd8fc9f, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=61bad78390ec42260746f4a4ea413ab6, ASSIGN}] 2023-07-18 10:12:10,544 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=61bad78390ec42260746f4a4ea413ab6, ASSIGN 2023-07-18 10:12:10,544 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6ff6715aec78db4b99cdb9ac6dd8fc9f, ASSIGN 2023-07-18 10:12:10,545 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=61bad78390ec42260746f4a4ea413ab6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34221,1689675027589; forceNewPlan=false, retain=false 2023-07-18 10:12:10,545 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6ff6715aec78db4b99cdb9ac6dd8fc9f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33757,1689675027667; forceNewPlan=false, retain=false 2023-07-18 10:12:10,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-18 10:12:10,695 INFO [jenkins-hbase4:46557] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-18 10:12:10,699 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=61bad78390ec42260746f4a4ea413ab6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:10,699 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689675130472.61bad78390ec42260746f4a4ea413ab6.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689675130699"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689675130699"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689675130699"}]},"ts":"1689675130699"} 2023-07-18 10:12:10,699 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=6ff6715aec78db4b99cdb9ac6dd8fc9f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:10,700 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689675130472.6ff6715aec78db4b99cdb9ac6dd8fc9f.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689675130699"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689675130699"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689675130699"}]},"ts":"1689675130699"} 2023-07-18 10:12:10,701 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure 61bad78390ec42260746f4a4ea413ab6, server=jenkins-hbase4.apache.org,34221,1689675027589}] 2023-07-18 10:12:10,702 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure 6ff6715aec78db4b99cdb9ac6dd8fc9f, server=jenkins-hbase4.apache.org,33757,1689675027667}] 2023-07-18 10:12:10,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-18 10:12:10,861 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689675130472.61bad78390ec42260746f4a4ea413ab6. 2023-07-18 10:12:10,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 61bad78390ec42260746f4a4ea413ab6, NAME => 'testtb-testEmptyExportFileSystemState,1,1689675130472.61bad78390ec42260746f4a4ea413ab6.', STARTKEY => '1', ENDKEY => ''} 2023-07-18 10:12:10,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689675130472.61bad78390ec42260746f4a4ea413ab6. service=AccessControlService 2023-07-18 10:12:10,862 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 10:12:10,862 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 61bad78390ec42260746f4a4ea413ab6 2023-07-18 10:12:10,862 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689675130472.61bad78390ec42260746f4a4ea413ab6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:12:10,862 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 61bad78390ec42260746f4a4ea413ab6 2023-07-18 10:12:10,862 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 61bad78390ec42260746f4a4ea413ab6 2023-07-18 10:12:10,865 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689675130472.6ff6715aec78db4b99cdb9ac6dd8fc9f. 2023-07-18 10:12:10,866 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6ff6715aec78db4b99cdb9ac6dd8fc9f, NAME => 'testtb-testEmptyExportFileSystemState,,1689675130472.6ff6715aec78db4b99cdb9ac6dd8fc9f.', STARTKEY => '', ENDKEY => '1'} 2023-07-18 10:12:10,866 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689675130472.6ff6715aec78db4b99cdb9ac6dd8fc9f. service=AccessControlService 2023-07-18 10:12:10,866 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 10:12:10,866 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 6ff6715aec78db4b99cdb9ac6dd8fc9f 2023-07-18 10:12:10,866 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689675130472.6ff6715aec78db4b99cdb9ac6dd8fc9f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:12:10,867 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6ff6715aec78db4b99cdb9ac6dd8fc9f 2023-07-18 10:12:10,867 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6ff6715aec78db4b99cdb9ac6dd8fc9f 2023-07-18 10:12:10,873 INFO [StoreOpener-61bad78390ec42260746f4a4ea413ab6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 61bad78390ec42260746f4a4ea413ab6 2023-07-18 10:12:10,875 INFO [StoreOpener-6ff6715aec78db4b99cdb9ac6dd8fc9f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6ff6715aec78db4b99cdb9ac6dd8fc9f 2023-07-18 10:12:10,876 DEBUG [StoreOpener-6ff6715aec78db4b99cdb9ac6dd8fc9f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testEmptyExportFileSystemState/6ff6715aec78db4b99cdb9ac6dd8fc9f/cf 2023-07-18 10:12:10,876 DEBUG [StoreOpener-6ff6715aec78db4b99cdb9ac6dd8fc9f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testEmptyExportFileSystemState/6ff6715aec78db4b99cdb9ac6dd8fc9f/cf 2023-07-18 10:12:10,876 INFO [StoreOpener-6ff6715aec78db4b99cdb9ac6dd8fc9f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6ff6715aec78db4b99cdb9ac6dd8fc9f columnFamilyName cf 2023-07-18 10:12:10,877 INFO [StoreOpener-6ff6715aec78db4b99cdb9ac6dd8fc9f-1] regionserver.HStore(310): Store=6ff6715aec78db4b99cdb9ac6dd8fc9f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 10:12:10,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testEmptyExportFileSystemState/6ff6715aec78db4b99cdb9ac6dd8fc9f 2023-07-18 10:12:10,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testEmptyExportFileSystemState/6ff6715aec78db4b99cdb9ac6dd8fc9f 2023-07-18 10:12:10,878 DEBUG [StoreOpener-61bad78390ec42260746f4a4ea413ab6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testEmptyExportFileSystemState/61bad78390ec42260746f4a4ea413ab6/cf 2023-07-18 10:12:10,879 DEBUG [StoreOpener-61bad78390ec42260746f4a4ea413ab6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testEmptyExportFileSystemState/61bad78390ec42260746f4a4ea413ab6/cf 2023-07-18 10:12:10,879 INFO [StoreOpener-61bad78390ec42260746f4a4ea413ab6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 61bad78390ec42260746f4a4ea413ab6 columnFamilyName cf 2023-07-18 10:12:10,880 INFO [StoreOpener-61bad78390ec42260746f4a4ea413ab6-1] regionserver.HStore(310): Store=61bad78390ec42260746f4a4ea413ab6/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 10:12:10,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testEmptyExportFileSystemState/61bad78390ec42260746f4a4ea413ab6 2023-07-18 10:12:10,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testEmptyExportFileSystemState/61bad78390ec42260746f4a4ea413ab6 2023-07-18 10:12:10,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6ff6715aec78db4b99cdb9ac6dd8fc9f 2023-07-18 10:12:10,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testEmptyExportFileSystemState/6ff6715aec78db4b99cdb9ac6dd8fc9f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 10:12:10,895 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6ff6715aec78db4b99cdb9ac6dd8fc9f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60950625, jitterRate=-0.0917649120092392}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 10:12:10,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6ff6715aec78db4b99cdb9ac6dd8fc9f: 2023-07-18 10:12:10,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 61bad78390ec42260746f4a4ea413ab6 2023-07-18 10:12:10,896 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689675130472.6ff6715aec78db4b99cdb9ac6dd8fc9f., pid=94, masterSystemTime=1689675130861 2023-07-18 10:12:10,898 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689675130472.6ff6715aec78db4b99cdb9ac6dd8fc9f. 2023-07-18 10:12:10,898 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689675130472.6ff6715aec78db4b99cdb9ac6dd8fc9f. 2023-07-18 10:12:10,898 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=6ff6715aec78db4b99cdb9ac6dd8fc9f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:10,898 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689675130472.6ff6715aec78db4b99cdb9ac6dd8fc9f.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689675130898"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689675130898"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689675130898"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689675130898"}]},"ts":"1689675130898"} 2023-07-18 10:12:10,901 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=91 2023-07-18 10:12:10,901 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure 6ff6715aec78db4b99cdb9ac6dd8fc9f, server=jenkins-hbase4.apache.org,33757,1689675027667 in 198 msec 2023-07-18 10:12:10,902 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6ff6715aec78db4b99cdb9ac6dd8fc9f, ASSIGN in 359 msec 2023-07-18 10:12:10,903 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testEmptyExportFileSystemState/61bad78390ec42260746f4a4ea413ab6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 10:12:10,903 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 61bad78390ec42260746f4a4ea413ab6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64137857, jitterRate=-0.044271454215049744}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 10:12:10,903 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 61bad78390ec42260746f4a4ea413ab6: 2023-07-18 10:12:10,904 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689675130472.61bad78390ec42260746f4a4ea413ab6., pid=93, masterSystemTime=1689675130853 2023-07-18 10:12:10,905 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689675130472.61bad78390ec42260746f4a4ea413ab6. 2023-07-18 10:12:10,905 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689675130472.61bad78390ec42260746f4a4ea413ab6. 2023-07-18 10:12:10,908 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=61bad78390ec42260746f4a4ea413ab6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:10,908 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689675130472.61bad78390ec42260746f4a4ea413ab6.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689675130908"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689675130908"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689675130908"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689675130908"}]},"ts":"1689675130908"} 2023-07-18 10:12:10,914 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=92 2023-07-18 10:12:10,914 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure 61bad78390ec42260746f4a4ea413ab6, server=jenkins-hbase4.apache.org,34221,1689675027589 in 211 msec 2023-07-18 10:12:10,916 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-07-18 10:12:10,916 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=61bad78390ec42260746f4a4ea413ab6, ASSIGN in 372 msec 2023-07-18 10:12:10,917 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 10:12:10,917 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689675130917"}]},"ts":"1689675130917"} 2023-07-18 10:12:10,918 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-18 10:12:10,920 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 10:12:10,921 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-18 10:12:10,923 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34221] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-18 10:12:10,926 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:12:10,926 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:12:10,926 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:12:10,926 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:12:10,927 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-18 10:12:10,928 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-18 10:12:10,928 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-18 10:12:10,928 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-18 10:12:10,929 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 456 msec 2023-07-18 10:12:11,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-18 10:12:11,083 INFO [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-18 10:12:11,083 DEBUG [Listener at jenkins-hbase4.apache.org/42677] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testEmptyExportFileSystemState get assigned. Timeout = 60000ms 2023-07-18 10:12:11,083 INFO [Listener at jenkins-hbase4.apache.org/42677] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 10:12:11,087 INFO [Listener at jenkins-hbase4.apache.org/42677] hbase.HBaseTestingUtility(3484): All regions for table testtb-testEmptyExportFileSystemState assigned to meta. Checking AM states. 2023-07-18 10:12:11,087 INFO [Listener at jenkins-hbase4.apache.org/42677] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 10:12:11,087 INFO [Listener at jenkins-hbase4.apache.org/42677] hbase.HBaseTestingUtility(3504): All regions for table testtb-testEmptyExportFileSystemState assigned. 2023-07-18 10:12:11,091 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 10:12:11,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689675131091 (current time:1689675131091). 2023-07-18 10:12:11,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 10:12:11,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] zookeeper.ReadOnlyZKClient(139): Connect 0x62609cb9 to 127.0.0.1:56089 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 10:12:11,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5966ac97, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 10:12:11,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:12:11,108 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59942, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:12:11,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x62609cb9 to 127.0.0.1:56089 2023-07-18 10:12:11,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 10:12:11,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] zookeeper.ReadOnlyZKClient(139): Connect 0x24cb3244 to 127.0.0.1:56089 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 10:12:11,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@42a8f730, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 10:12:11,231 DEBUG [hconnection-0x2ec6e9e6-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:12:11,236 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59950, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:12:11,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:12:11,245 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47630, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:12:11,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x24cb3244 to 127.0.0.1:56089 2023-07-18 10:12:11,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 10:12:11,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-18 10:12:11,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 10:12:11,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 10:12:11,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-18 10:12:11,251 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-18 10:12:11,252 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689675731252 2023-07-18 10:12:11,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 10:12:11,252 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-18 10:12:11,260 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 10:12:11,260 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 10:12:11,271 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-18 10:12:11,273 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-18 10:12:11,277 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 24 msec 2023-07-18 10:12:11,281 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-18 10:12:11,283 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689675731283 2023-07-18 10:12:11,345 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,345 INFO [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-18 10:12:11,345 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:12:11,347 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-18 10:12:11,347 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-18 10:12:11,348 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,348 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,355 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:12:11,355 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:12:11,355 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:11,355 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:12:11,355 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:12:11,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:12:11,355 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:12:11,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:12:11,355 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:12:11,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:12:11,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,356 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:11,356 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:11,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,356 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:11,356 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 10:12:11,356 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,357 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-18 10:12:11,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,357 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,357 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-18 10:12:11,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-18 10:12:11,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,358 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-18 10:12:11,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-18 10:12:11,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,358 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-18 10:12:11,358 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,358 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-18 10:12:11,358 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,358 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:12:11,358 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-18 10:12:11,358 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:12:11,360 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-18 10:12:11,360 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,360 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-18 10:12:11,360 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34221,1689675027589' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-18 10:12:11,360 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-18 10:12:11,360 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-18 10:12:11,360 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:12:11,360 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-18 10:12:11,360 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 10:12:11,362 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40089,1689675027524' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-18 10:12:11,361 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-18 10:12:11,362 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-18 10:12:11,362 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33757,1689675027667' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-18 10:12:11,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 10:12:11,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-18 10:12:11,363 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:11,364 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:11,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:12:11,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:12:11,363 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 10:12:11,364 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,365 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:11,365 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,367 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:12:11,367 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,368 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,368 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:12:11,368 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:12:11,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:12:11,368 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:12:11,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:12:11,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:11,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:11,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:12:11,370 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34221,1689675027589' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-18 10:12:11,370 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7b49bb93[Count = 1] remaining members to acquire global barrier 2023-07-18 10:12:11,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:11,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:12:11,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:12:11,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:12:11,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:12:11,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:12:11,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:11,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:11,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:12:11,384 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33757,1689675027667' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-18 10:12:11,384 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7b49bb93[Count = 0] remaining members to acquire global barrier 2023-07-18 10:12:11,384 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-18 10:12:11,384 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,388 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,388 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,388 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,388 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,389 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-18 10:12:11,389 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-18 10:12:11,389 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40089,1689675027524' in zk 2023-07-18 10:12:11,389 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:11,389 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:11,389 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 10:12:11,390 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-18 10:12:11,390 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:12:11,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,391 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-18 10:12:11,391 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-18 10:12:11,391 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-18 10:12:11,391 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 10:12:11,393 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 10:12:11,393 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 10:12:11,393 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 10:12:11,393 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689675130472.6ff6715aec78db4b99cdb9ac6dd8fc9f. 2023-07-18 10:12:11,393 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689675130472.61bad78390ec42260746f4a4ea413ab6. 2023-07-18 10:12:11,393 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689675130472.6ff6715aec78db4b99cdb9ac6dd8fc9f. started... 2023-07-18 10:12:11,393 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689675130472.61bad78390ec42260746f4a4ea413ab6. started... 2023-07-18 10:12:11,404 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 61bad78390ec42260746f4a4ea413ab6: 2023-07-18 10:12:11,404 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6ff6715aec78db4b99cdb9ac6dd8fc9f: 2023-07-18 10:12:11,405 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689675130472.61bad78390ec42260746f4a4ea413ab6.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,405 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 10:12:11,405 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 10:12:11,405 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689675130472.6ff6715aec78db4b99cdb9ac6dd8fc9f.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,405 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 10:12:11,405 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 10:12:11,427 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689675130472.61bad78390ec42260746f4a4ea413ab6. completed. 2023-07-18 10:12:11,427 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689675130472.61bad78390ec42260746f4a4ea413ab6. 2023-07-18 10:12:11,427 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 10:12:11,427 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 10:12:11,427 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:11,427 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-18 10:12:11,427 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34221,1689675027589' in zk 2023-07-18 10:12:11,429 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-18 10:12:11,429 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:11,429 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:12:11,429 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-18 10:12:11,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:11,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:12:11,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:12:11,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:12:11,431 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689675130472.6ff6715aec78db4b99cdb9ac6dd8fc9f. completed. 2023-07-18 10:12:11,431 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689675130472.6ff6715aec78db4b99cdb9ac6dd8fc9f. 2023-07-18 10:12:11,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:12:11,431 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 10:12:11,431 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 10:12:11,431 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:11,432 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-18 10:12:11,432 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33757,1689675027667' in zk 2023-07-18 10:12:11,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:12:11,433 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:11,433 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-18 10:12:11,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:11,433 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:12:11,433 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-18 10:12:11,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:11,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:12:11,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:12:11,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:11,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:11,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,34221,1689675027589': 2023-07-18 10:12:11,437 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34221,1689675027589' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-18 10:12:11,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:11,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:12:11,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:12:11,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:12:11,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:12:11,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:12:11,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:11,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:11,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:12:11,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:12:11,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:11,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:11,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,33757,1689675027667': 2023-07-18 10:12:11,440 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33757,1689675027667' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-18 10:12:11,440 INFO [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-18 10:12:11,441 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 10:12:11,441 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 10:12:11,441 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,441 INFO [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 10:12:11,443 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,443 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:12:11,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:12:11,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,443 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:12:11,443 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,443 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:12:11,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,443 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:12:11,443 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:12:11,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,444 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:12:11,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:12:11,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:12:11,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:12:11,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:12:11,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:12:11,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:12:11,444 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:11,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:12:11,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,445 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:11,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:12:11,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:11,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:11,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:12:11,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,447 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:12:11,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:12:11,447 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:11,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:11,447 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:11,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:11,450 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:12:11,450 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:12:11,450 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:11,450 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:12:11,450 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:12:11,450 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:12:11,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:12:11,450 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:12:11,450 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:12:11,450 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:12:11,450 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,450 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:12:11,450 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:12:11,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:12:11,452 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:11,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:12:11,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:12:11,450 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:12:11,452 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:12:11,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:12:11,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:12:11,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:12:11,452 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:12:11,452 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,452 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:11,452 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,452 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:11,452 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:12:11,452 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,453 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,453 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,469 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,495 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-18 10:12:11,495 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,495 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,495 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689675131252Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689675131452 (+200 ms)Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689675131452Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689675131455 (+3 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689675131463 (+8 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689675131495 (+32 ms) 2023-07-18 10:12:11,500 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-18 10:12:11,502 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 247 msec 2023-07-18 10:12:11,564 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 10:12:11,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 10:12:11,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 10:12:11,578 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33757] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689675130472.6ff6715aec78db4b99cdb9ac6dd8fc9f. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 10:12:11,581 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34221] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689675130472.61bad78390ec42260746f4a4ea413ab6. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 10:12:11,584 DEBUG [Listener at jenkins-hbase4.apache.org/42677] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-18 10:12:11,584 DEBUG [Listener at jenkins-hbase4.apache.org/42677] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689675130472.6ff6715aec78db4b99cdb9ac6dd8fc9f. 2023-07-18 10:12:11,585 INFO [Listener at jenkins-hbase4.apache.org/42677] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 10:12:11,598 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 10:12:11,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689675131599 (current time:1689675131599). 2023-07-18 10:12:11,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 10:12:11,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] zookeeper.ReadOnlyZKClient(139): Connect 0x1160db6c to 127.0.0.1:56089 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 10:12:11,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@8f0997f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 10:12:11,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:12:11,613 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59962, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:12:11,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1160db6c to 127.0.0.1:56089 2023-07-18 10:12:11,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 10:12:11,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] zookeeper.ReadOnlyZKClient(139): Connect 0x57b835fb to 127.0.0.1:56089 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 10:12:11,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@40943fdb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 10:12:11,635 DEBUG [hconnection-0x4ca37dd7-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:12:11,637 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59964, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:12:11,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:12:11,642 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47632, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:12:11,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x57b835fb to 127.0.0.1:56089 2023-07-18 10:12:11,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 10:12:11,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-18 10:12:11,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 10:12:11,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 10:12:11,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-18 10:12:11,649 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-18 10:12:11,650 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689675731650 2023-07-18 10:12:11,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 10:12:11,650 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-18 10:12:11,650 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 10:12:11,652 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 10:12:11,659 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-18 10:12:11,659 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-18 10:12:11,660 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 13 msec 2023-07-18 10:12:11,662 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-18 10:12:11,662 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689675731662 2023-07-18 10:12:11,691 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,692 INFO [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-18 10:12:11,692 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:12:11,693 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-18 10:12:11,693 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-18 10:12:11,751 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,751 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,752 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 10:12:11,753 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:11,753 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:12:11,753 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:12:11,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 10:12:11,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:12:11,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-18 10:12:11,753 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:12:11,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:12:11,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:12:11,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:12:11,753 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 10:12:11,753 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:11,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:12:11,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:12:11,753 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:11,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,754 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,754 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:11,754 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,754 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 10:12:11,754 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-18 10:12:11,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-18 10:12:11,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,755 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-18 10:12:11,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-18 10:12:11,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,755 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-18 10:12:11,755 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-18 10:12:11,755 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,755 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,755 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-18 10:12:11,755 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,755 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-18 10:12:11,755 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-18 10:12:11,755 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:12:11,755 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:12:11,755 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:12:11,758 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-18 10:12:11,762 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-18 10:12:11,757 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-18 10:12:11,762 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33757,1689675027667' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-18 10:12:11,762 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-18 10:12:11,762 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-18 10:12:11,762 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-18 10:12:11,762 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34221,1689675027589' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-18 10:12:11,762 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40089,1689675027524' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-18 10:12:11,764 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,764 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:11,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:11,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:12:11,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:12:11,766 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:11,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:12:11,766 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,766 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,766 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,766 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:12:11,766 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,767 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:12:11,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:12:11,767 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,767 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:12:11,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:11,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:12:11,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:11,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:12:11,769 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33757,1689675027667' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-18 10:12:11,769 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7a32b3b3[Count = 1] remaining members to acquire global barrier 2023-07-18 10:12:11,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:11,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:12:11,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:12:11,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:12:11,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:12:11,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:11,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:12:11,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:11,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:12:11,772 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34221,1689675027589' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-18 10:12:11,772 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7a32b3b3[Count = 0] remaining members to acquire global barrier 2023-07-18 10:12:11,772 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-18 10:12:11,772 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,777 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,777 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,777 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,777 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-18 10:12:11,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,777 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:11,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,777 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-18 10:12:11,777 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-18 10:12:11,777 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 10:12:11,778 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 10:12:11,778 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:11,778 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 10:12:11,778 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689675130472.61bad78390ec42260746f4a4ea413ab6. 2023-07-18 10:12:11,778 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 10:12:11,778 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689675130472.61bad78390ec42260746f4a4ea413ab6. started... 2023-07-18 10:12:11,778 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 10:12:11,777 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-18 10:12:11,777 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689675130472.6ff6715aec78db4b99cdb9ac6dd8fc9f. 2023-07-18 10:12:11,778 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40089,1689675027524' in zk 2023-07-18 10:12:11,778 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689675130472.6ff6715aec78db4b99cdb9ac6dd8fc9f. started... 2023-07-18 10:12:11,778 INFO [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 61bad78390ec42260746f4a4ea413ab6 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-18 10:12:11,778 INFO [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6ff6715aec78db4b99cdb9ac6dd8fc9f 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-18 10:12:11,780 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-18 10:12:11,780 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:12:11,780 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-18 10:12:11,822 INFO [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=333 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testEmptyExportFileSystemState/6ff6715aec78db4b99cdb9ac6dd8fc9f/.tmp/cf/90002276ae224c0db3d39a8e1368b61f 2023-07-18 10:12:11,831 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testEmptyExportFileSystemState/6ff6715aec78db4b99cdb9ac6dd8fc9f/.tmp/cf/90002276ae224c0db3d39a8e1368b61f as hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testEmptyExportFileSystemState/6ff6715aec78db4b99cdb9ac6dd8fc9f/cf/90002276ae224c0db3d39a8e1368b61f 2023-07-18 10:12:11,835 INFO [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.93 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testEmptyExportFileSystemState/61bad78390ec42260746f4a4ea413ab6/.tmp/cf/c21d3839a1e74e5fac69cdbe57ec59ae 2023-07-18 10:12:11,840 INFO [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testEmptyExportFileSystemState/6ff6715aec78db4b99cdb9ac6dd8fc9f/cf/90002276ae224c0db3d39a8e1368b61f, entries=5, sequenceid=6, filesize=5.2 K 2023-07-18 10:12:11,842 INFO [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 6ff6715aec78db4b99cdb9ac6dd8fc9f in 64ms, sequenceid=6, compaction requested=false 2023-07-18 10:12:11,842 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-18 10:12:11,842 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testEmptyExportFileSystemState/61bad78390ec42260746f4a4ea413ab6/.tmp/cf/c21d3839a1e74e5fac69cdbe57ec59ae as hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testEmptyExportFileSystemState/61bad78390ec42260746f4a4ea413ab6/cf/c21d3839a1e74e5fac69cdbe57ec59ae 2023-07-18 10:12:11,842 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6ff6715aec78db4b99cdb9ac6dd8fc9f: 2023-07-18 10:12:11,843 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689675130472.6ff6715aec78db4b99cdb9ac6dd8fc9f.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,843 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 10:12:11,843 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testEmptyExportFileSystemState/6ff6715aec78db4b99cdb9ac6dd8fc9f/cf/90002276ae224c0db3d39a8e1368b61f] hfiles 2023-07-18 10:12:11,843 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testEmptyExportFileSystemState/6ff6715aec78db4b99cdb9ac6dd8fc9f/cf/90002276ae224c0db3d39a8e1368b61f for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,849 INFO [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testEmptyExportFileSystemState/61bad78390ec42260746f4a4ea413ab6/cf/c21d3839a1e74e5fac69cdbe57ec59ae, entries=45, sequenceid=6, filesize=7.9 K 2023-07-18 10:12:11,850 INFO [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 61bad78390ec42260746f4a4ea413ab6 in 72ms, sequenceid=6, compaction requested=false 2023-07-18 10:12:11,852 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 61bad78390ec42260746f4a4ea413ab6: 2023-07-18 10:12:11,852 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689675130472.61bad78390ec42260746f4a4ea413ab6.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,852 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 10:12:11,852 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testEmptyExportFileSystemState/61bad78390ec42260746f4a4ea413ab6/cf/c21d3839a1e74e5fac69cdbe57ec59ae] hfiles 2023-07-18 10:12:11,852 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testEmptyExportFileSystemState/61bad78390ec42260746f4a4ea413ab6/cf/c21d3839a1e74e5fac69cdbe57ec59ae for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,861 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689675130472.6ff6715aec78db4b99cdb9ac6dd8fc9f. completed. 2023-07-18 10:12:11,861 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689675130472.6ff6715aec78db4b99cdb9ac6dd8fc9f. 2023-07-18 10:12:11,861 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 10:12:11,861 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 10:12:11,861 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:11,861 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-18 10:12:11,861 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33757,1689675027667' in zk 2023-07-18 10:12:11,863 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-18 10:12:11,863 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:11,863 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:12:11,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:11,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:12:11,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:12:11,863 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-18 10:12:11,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:12:11,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:12:11,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:11,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:12:11,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:11,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:12:11,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:12:11,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:11,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,33757,1689675027667': 2023-07-18 10:12:11,870 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33757,1689675027667' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-18 10:12:11,873 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689675130472.61bad78390ec42260746f4a4ea413ab6. completed. 2023-07-18 10:12:11,874 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689675130472.61bad78390ec42260746f4a4ea413ab6. 2023-07-18 10:12:11,874 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 10:12:11,874 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 10:12:11,874 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:11,874 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-18 10:12:11,874 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34221,1689675027589' in zk 2023-07-18 10:12:11,875 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:11,875 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-18 10:12:11,875 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:12:11,875 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-18 10:12:11,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:11,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:12:11,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:12:11,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:12:11,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:12:11,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:11,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:12:11,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:11,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:12:11,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:12:11,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:11,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:11,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,34221,1689675027589': 2023-07-18 10:12:11,884 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34221,1689675027589' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-18 10:12:11,884 INFO [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-18 10:12:11,884 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 10:12:11,884 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 10:12:11,884 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,884 INFO [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 10:12:11,886 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,886 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,886 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:12:11,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,886 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,886 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,886 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:12:11,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:12:11,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:12:11,886 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:12:11,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:12:11,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:12:11,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:12:11,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:12:11,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:12:11,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,888 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:11,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:12:11,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:12:11,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,889 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:12:11,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,889 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:11,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:12:11,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:11,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:12:11,893 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:12:11,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:11,893 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:11,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:12:11,894 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:11,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:12:11,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:11,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:11,899 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:12:11,899 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:12:11,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:12:11,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:12:11,899 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:12:11,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:12:11,899 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:12:11,899 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:11,899 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:12:11,899 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:12:11,901 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,899 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:12:11,901 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:12:11,899 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:12:11,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:12:11,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:12:11,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:12:11,901 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:12:11,901 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:11,901 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:12:11,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:12:11,901 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:11,902 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,902 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:11,902 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:12:11,902 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,902 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,902 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,902 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:12:11,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:12:11,935 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,953 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 10:12:11,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 10:12:11,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-18 10:12:11,955 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-18 10:12:11,979 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-18 10:12:11,979 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,980 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:11,980 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689675131650Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689675131901 (+251 ms)Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689675131901Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689675131911 (+10 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689675131927 (+16 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689675131979 (+52 ms) 2023-07-18 10:12:11,987 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-18 10:12:11,989 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 335 msec 2023-07-18 10:12:12,263 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 10:12:12,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 10:12:12,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 10:12:12,265 INFO [Listener at jenkins-hbase4.apache.org/42677] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/export-test/export-1689675132265 2023-07-18 10:12:12,266 INFO [Listener at jenkins-hbase4.apache.org/42677] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35953, tgtDir=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/export-test/export-1689675132265, rawTgtDir=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/export-test/export-1689675132265, srcFsUri=hdfs://localhost:35953, srcDir=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336 2023-07-18 10:12:12,295 DEBUG [Listener at jenkins-hbase4.apache.org/42677] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35953, inputRoot=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336 2023-07-18 10:12:12,295 DEBUG [Listener at jenkins-hbase4.apache.org/42677] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_939068277_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/export-test/export-1689675132265, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/export-test/export-1689675132265/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:12,295 INFO [Listener at jenkins-hbase4.apache.org/42677] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35953, inputRoot=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336, snapshotDir=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-18 10:12:12,327 INFO [Listener at jenkins-hbase4.apache.org/42677] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/export-test/export-1689675132265/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:12,416 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-18 10:12:12,417 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-18 10:12:12,417 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-18 10:12:12,417 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-18 10:12:12,418 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-18 10:12:12,418 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-18 10:12:12,419 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-18 10:12:12,504 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/hadoop-395746585730170608.jar 2023-07-18 10:12:12,505 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-18 10:12:12,505 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-18 10:12:12,506 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-18 10:12:12,506 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-18 10:12:12,507 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-18 10:12:12,507 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-18 10:12:12,508 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-18 10:12:12,509 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-18 10:12:12,509 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-18 10:12:12,510 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-18 10:12:12,510 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-18 10:12:12,510 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-18 10:12:12,511 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-18 10:12:12,511 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-18 10:12:12,512 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-18 10:12:12,512 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-18 10:12:12,513 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 10:12:12,513 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 10:12:12,514 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 10:12:12,514 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 10:12:12,514 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 10:12:12,515 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 10:12:12,515 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 10:12:13,726 WARN [Listener at jenkins-hbase4.apache.org/42677] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-18 10:12:13,730 INFO [Listener at jenkins-hbase4.apache.org/42677] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-18 10:12:14,509 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 10:12:14,509 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 10:12:14,513 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689675035639_0005_000001 (auth:SIMPLE) 2023-07-18 10:12:15,276 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689675035639_0006_000001 (auth:SIMPLE) 2023-07-18 10:12:15,316 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-18 10:12:21,549 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689675035639_0006_000001 (auth:SIMPLE) 2023-07-18 10:12:23,990 INFO [Listener at jenkins-hbase4.apache.org/42677] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-18 10:12:23,993 INFO [Listener at jenkins-hbase4.apache.org/42677] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-18 10:12:24,003 INFO [Listener at jenkins-hbase4.apache.org/42677] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:24,003 INFO [Listener at jenkins-hbase4.apache.org/42677] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-18 10:12:24,003 INFO [Listener at jenkins-hbase4.apache.org/42677] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-18 10:12:24,003 DEBUG [Listener at jenkins-hbase4.apache.org/42677] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1314676217_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:24,004 DEBUG [Listener at jenkins-hbase4.apache.org/42677] snapshot.TestExportSnapshot(367): hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-18 10:12:24,004 DEBUG [Listener at jenkins-hbase4.apache.org/42677] snapshot.TestExportSnapshot(367): hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-18 10:12:24,004 DEBUG [Listener at jenkins-hbase4.apache.org/42677] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1314676217_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/export-test/export-1689675132265/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/export-test/export-1689675132265/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:24,004 DEBUG [Listener at jenkins-hbase4.apache.org/42677] snapshot.TestExportSnapshot(367): hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/export-test/export-1689675132265/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-18 10:12:24,005 DEBUG [Listener at jenkins-hbase4.apache.org/42677] snapshot.TestExportSnapshot(367): hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/export-test/export-1689675132265/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-18 10:12:24,010 INFO [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-18 10:12:24,010 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-18 10:12:24,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-18 10:12:24,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-18 10:12:24,014 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689675144014"}]},"ts":"1689675144014"} 2023-07-18 10:12:24,016 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-18 10:12:24,017 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-18 10:12:24,018 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6ff6715aec78db4b99cdb9ac6dd8fc9f, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=61bad78390ec42260746f4a4ea413ab6, UNASSIGN}] 2023-07-18 10:12:24,020 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6ff6715aec78db4b99cdb9ac6dd8fc9f, UNASSIGN 2023-07-18 10:12:24,020 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=61bad78390ec42260746f4a4ea413ab6, UNASSIGN 2023-07-18 10:12:24,020 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=6ff6715aec78db4b99cdb9ac6dd8fc9f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:24,020 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=61bad78390ec42260746f4a4ea413ab6, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:24,021 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689675130472.6ff6715aec78db4b99cdb9ac6dd8fc9f.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689675144020"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689675144020"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689675144020"}]},"ts":"1689675144020"} 2023-07-18 10:12:24,021 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689675130472.61bad78390ec42260746f4a4ea413ab6.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689675144020"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689675144020"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689675144020"}]},"ts":"1689675144020"} 2023-07-18 10:12:24,022 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 6ff6715aec78db4b99cdb9ac6dd8fc9f, server=jenkins-hbase4.apache.org,33757,1689675027667}] 2023-07-18 10:12:24,023 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure 61bad78390ec42260746f4a4ea413ab6, server=jenkins-hbase4.apache.org,34221,1689675027589}] 2023-07-18 10:12:24,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-18 10:12:24,174 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6ff6715aec78db4b99cdb9ac6dd8fc9f 2023-07-18 10:12:24,175 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6ff6715aec78db4b99cdb9ac6dd8fc9f, disabling compactions & flushes 2023-07-18 10:12:24,175 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689675130472.6ff6715aec78db4b99cdb9ac6dd8fc9f. 2023-07-18 10:12:24,175 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689675130472.6ff6715aec78db4b99cdb9ac6dd8fc9f. 2023-07-18 10:12:24,175 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689675130472.6ff6715aec78db4b99cdb9ac6dd8fc9f. after waiting 0 ms 2023-07-18 10:12:24,175 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689675130472.6ff6715aec78db4b99cdb9ac6dd8fc9f. 2023-07-18 10:12:24,175 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 61bad78390ec42260746f4a4ea413ab6 2023-07-18 10:12:24,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 61bad78390ec42260746f4a4ea413ab6, disabling compactions & flushes 2023-07-18 10:12:24,176 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689675130472.61bad78390ec42260746f4a4ea413ab6. 2023-07-18 10:12:24,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689675130472.61bad78390ec42260746f4a4ea413ab6. 2023-07-18 10:12:24,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689675130472.61bad78390ec42260746f4a4ea413ab6. after waiting 0 ms 2023-07-18 10:12:24,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689675130472.61bad78390ec42260746f4a4ea413ab6. 2023-07-18 10:12:24,209 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testEmptyExportFileSystemState/6ff6715aec78db4b99cdb9ac6dd8fc9f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 10:12:24,209 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testEmptyExportFileSystemState/61bad78390ec42260746f4a4ea413ab6/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 10:12:24,209 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 10:12:24,210 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 10:12:24,211 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689675130472.6ff6715aec78db4b99cdb9ac6dd8fc9f. 2023-07-18 10:12:24,211 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689675130472.61bad78390ec42260746f4a4ea413ab6. 2023-07-18 10:12:24,211 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6ff6715aec78db4b99cdb9ac6dd8fc9f: 2023-07-18 10:12:24,211 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 61bad78390ec42260746f4a4ea413ab6: 2023-07-18 10:12:24,213 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6ff6715aec78db4b99cdb9ac6dd8fc9f 2023-07-18 10:12:24,213 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=6ff6715aec78db4b99cdb9ac6dd8fc9f, regionState=CLOSED 2023-07-18 10:12:24,213 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689675130472.6ff6715aec78db4b99cdb9ac6dd8fc9f.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689675144213"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689675144213"}]},"ts":"1689675144213"} 2023-07-18 10:12:24,213 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 61bad78390ec42260746f4a4ea413ab6 2023-07-18 10:12:24,214 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=61bad78390ec42260746f4a4ea413ab6, regionState=CLOSED 2023-07-18 10:12:24,214 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689675130472.61bad78390ec42260746f4a4ea413ab6.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689675144214"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689675144214"}]},"ts":"1689675144214"} 2023-07-18 10:12:24,217 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-07-18 10:12:24,217 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 6ff6715aec78db4b99cdb9ac6dd8fc9f, server=jenkins-hbase4.apache.org,33757,1689675027667 in 193 msec 2023-07-18 10:12:24,219 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=101 2023-07-18 10:12:24,219 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure 61bad78390ec42260746f4a4ea413ab6, server=jenkins-hbase4.apache.org,34221,1689675027589 in 193 msec 2023-07-18 10:12:24,219 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6ff6715aec78db4b99cdb9ac6dd8fc9f, UNASSIGN in 199 msec 2023-07-18 10:12:24,221 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-07-18 10:12:24,221 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=61bad78390ec42260746f4a4ea413ab6, UNASSIGN in 201 msec 2023-07-18 10:12:24,221 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689675144221"}]},"ts":"1689675144221"} 2023-07-18 10:12:24,223 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-18 10:12:24,224 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-18 10:12:24,231 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 215 msec 2023-07-18 10:12:24,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-18 10:12:24,319 INFO [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-18 10:12:24,320 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-18 10:12:24,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-18 10:12:24,324 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-18 10:12:24,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-18 10:12:24,326 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-18 10:12:24,327 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34221] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-18 10:12:24,332 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testEmptyExportFileSystemState/61bad78390ec42260746f4a4ea413ab6 2023-07-18 10:12:24,333 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testEmptyExportFileSystemState/6ff6715aec78db4b99cdb9ac6dd8fc9f 2023-07-18 10:12:24,333 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-18 10:12:24,333 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-18 10:12:24,333 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-18 10:12:24,333 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-18 10:12:24,334 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testEmptyExportFileSystemState/61bad78390ec42260746f4a4ea413ab6/cf, FileablePath, hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testEmptyExportFileSystemState/61bad78390ec42260746f4a4ea413ab6/recovered.edits] 2023-07-18 10:12:24,335 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:12:24,335 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data null 2023-07-18 10:12:24,335 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data null 2023-07-18 10:12:24,335 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-18 10:12:24,335 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:12:24,335 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data null 2023-07-18 10:12:24,335 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-18 10:12:24,335 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:12:24,335 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data null 2023-07-18 10:12:24,335 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-18 10:12:24,335 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:12:24,335 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-18 10:12:24,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-18 10:12:24,338 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testEmptyExportFileSystemState/6ff6715aec78db4b99cdb9ac6dd8fc9f/cf, FileablePath, hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testEmptyExportFileSystemState/6ff6715aec78db4b99cdb9ac6dd8fc9f/recovered.edits] 2023-07-18 10:12:24,342 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testEmptyExportFileSystemState/61bad78390ec42260746f4a4ea413ab6/cf/c21d3839a1e74e5fac69cdbe57ec59ae to hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/archive/data/default/testtb-testEmptyExportFileSystemState/61bad78390ec42260746f4a4ea413ab6/cf/c21d3839a1e74e5fac69cdbe57ec59ae 2023-07-18 10:12:24,348 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testEmptyExportFileSystemState/6ff6715aec78db4b99cdb9ac6dd8fc9f/cf/90002276ae224c0db3d39a8e1368b61f to hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/archive/data/default/testtb-testEmptyExportFileSystemState/6ff6715aec78db4b99cdb9ac6dd8fc9f/cf/90002276ae224c0db3d39a8e1368b61f 2023-07-18 10:12:24,350 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testEmptyExportFileSystemState/61bad78390ec42260746f4a4ea413ab6/recovered.edits/9.seqid to hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/archive/data/default/testtb-testEmptyExportFileSystemState/61bad78390ec42260746f4a4ea413ab6/recovered.edits/9.seqid 2023-07-18 10:12:24,351 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testEmptyExportFileSystemState/61bad78390ec42260746f4a4ea413ab6 2023-07-18 10:12:24,352 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testEmptyExportFileSystemState/6ff6715aec78db4b99cdb9ac6dd8fc9f/recovered.edits/9.seqid to hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/archive/data/default/testtb-testEmptyExportFileSystemState/6ff6715aec78db4b99cdb9ac6dd8fc9f/recovered.edits/9.seqid 2023-07-18 10:12:24,353 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testEmptyExportFileSystemState/6ff6715aec78db4b99cdb9ac6dd8fc9f 2023-07-18 10:12:24,353 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-18 10:12:24,356 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-18 10:12:24,369 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-18 10:12:24,372 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-18 10:12:24,373 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-18 10:12:24,373 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-18 10:12:24,373 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689675130472.6ff6715aec78db4b99cdb9ac6dd8fc9f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689675144373"}]},"ts":"9223372036854775807"} 2023-07-18 10:12:24,373 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689675130472.61bad78390ec42260746f4a4ea413ab6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689675144373"}]},"ts":"9223372036854775807"} 2023-07-18 10:12:24,375 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-18 10:12:24,375 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 6ff6715aec78db4b99cdb9ac6dd8fc9f, NAME => 'testtb-testEmptyExportFileSystemState,,1689675130472.6ff6715aec78db4b99cdb9ac6dd8fc9f.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 61bad78390ec42260746f4a4ea413ab6, NAME => 'testtb-testEmptyExportFileSystemState,1,1689675130472.61bad78390ec42260746f4a4ea413ab6.', STARTKEY => '1', ENDKEY => ''}] 2023-07-18 10:12:24,375 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-18 10:12:24,375 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689675144375"}]},"ts":"9223372036854775807"} 2023-07-18 10:12:24,377 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-18 10:12:24,380 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-18 10:12:24,381 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 60 msec 2023-07-18 10:12:24,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-18 10:12:24,438 INFO [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-18 10:12:24,447 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-18 10:12:24,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:24,451 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-18 10:12:24,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:24,482 INFO [Listener at jenkins-hbase4.apache.org/42677] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=764 (was 758) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_939068277_17 at /127.0.0.1:57138 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1314676217_17 at /127.0.0.1:39734 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1219299467_1 at /127.0.0.1:43268 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x56f36059-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x56f36059-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1314676217_17 at /127.0.0.1:37700 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4598 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: IPC Client (274932937) connection to jenkins-hbase4.apache.org/172.31.14.131:42677 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (274932937) connection to jenkins-hbase4.apache.org/172.31.14.131:42805 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (274932937) connection to jenkins-hbase4.apache.org/172.31.14.131:41521 from appattempt_1689675035639_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (274932937) connection to jenkins-hbase4.apache.org/172.31.14.131:33719 from appattempt_1689675035639_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1219299467_1 at /127.0.0.1:39718 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x56f36059-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x56f36059-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=909 (was 903) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=590 (was 488) - SystemLoadAverage LEAK? -, ProcessCount=184 (was 184), AvailableMemoryMB=1701 (was 2271) 2023-07-18 10:12:24,483 WARN [Listener at jenkins-hbase4.apache.org/42677] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-07-18 10:12:24,508 INFO [Listener at jenkins-hbase4.apache.org/42677] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=764, OpenFileDescriptor=909, MaxFileDescriptor=60000, SystemLoadAverage=590, ProcessCount=184, AvailableMemoryMB=1700 2023-07-18 10:12:24,508 WARN [Listener at jenkins-hbase4.apache.org/42677] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-07-18 10:12:24,511 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-18 10:12:24,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:24,514 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 10:12:24,515 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-18 10:12:24,515 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 10:12:24,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-18 10:12:24,518 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/87c0b68c675c4843c661c8529cf9af8d 2023-07-18 10:12:24,518 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ee9a5294ca27094d33add8191e9931e9 2023-07-18 10:12:24,518 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/87c0b68c675c4843c661c8529cf9af8d empty. 2023-07-18 10:12:24,518 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ee9a5294ca27094d33add8191e9931e9 empty. 2023-07-18 10:12:24,519 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/87c0b68c675c4843c661c8529cf9af8d 2023-07-18 10:12:24,519 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ee9a5294ca27094d33add8191e9931e9 2023-07-18 10:12:24,519 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-18 10:12:24,576 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-18 10:12:24,578 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => ee9a5294ca27094d33add8191e9931e9, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689675144511.ee9a5294ca27094d33add8191e9931e9.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp 2023-07-18 10:12:24,578 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 87c0b68c675c4843c661c8529cf9af8d, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689675144511.87c0b68c675c4843c661c8529cf9af8d.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp 2023-07-18 10:12:24,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-18 10:12:24,642 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689675144511.87c0b68c675c4843c661c8529cf9af8d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:12:24,642 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 87c0b68c675c4843c661c8529cf9af8d, disabling compactions & flushes 2023-07-18 10:12:24,642 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689675144511.87c0b68c675c4843c661c8529cf9af8d. 2023-07-18 10:12:24,642 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689675144511.87c0b68c675c4843c661c8529cf9af8d. 2023-07-18 10:12:24,642 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689675144511.87c0b68c675c4843c661c8529cf9af8d. after waiting 0 ms 2023-07-18 10:12:24,642 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689675144511.87c0b68c675c4843c661c8529cf9af8d. 2023-07-18 10:12:24,642 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689675144511.87c0b68c675c4843c661c8529cf9af8d. 2023-07-18 10:12:24,642 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689675144511.ee9a5294ca27094d33add8191e9931e9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:12:24,642 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 87c0b68c675c4843c661c8529cf9af8d: 2023-07-18 10:12:24,642 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing ee9a5294ca27094d33add8191e9931e9, disabling compactions & flushes 2023-07-18 10:12:24,642 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689675144511.ee9a5294ca27094d33add8191e9931e9. 2023-07-18 10:12:24,642 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689675144511.ee9a5294ca27094d33add8191e9931e9. 2023-07-18 10:12:24,642 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689675144511.ee9a5294ca27094d33add8191e9931e9. after waiting 0 ms 2023-07-18 10:12:24,642 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689675144511.ee9a5294ca27094d33add8191e9931e9. 2023-07-18 10:12:24,642 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689675144511.ee9a5294ca27094d33add8191e9931e9. 2023-07-18 10:12:24,643 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for ee9a5294ca27094d33add8191e9931e9: 2023-07-18 10:12:24,646 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 10:12:24,647 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689675144511.87c0b68c675c4843c661c8529cf9af8d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689675144646"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689675144646"}]},"ts":"1689675144646"} 2023-07-18 10:12:24,647 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689675144511.ee9a5294ca27094d33add8191e9931e9.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689675144646"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689675144646"}]},"ts":"1689675144646"} 2023-07-18 10:12:24,649 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-18 10:12:24,650 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 10:12:24,650 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689675144650"}]},"ts":"1689675144650"} 2023-07-18 10:12:24,652 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-18 10:12:24,657 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 10:12:24,658 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 10:12:24,658 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 10:12:24,658 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 10:12:24,658 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 10:12:24,658 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=87c0b68c675c4843c661c8529cf9af8d, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ee9a5294ca27094d33add8191e9931e9, ASSIGN}] 2023-07-18 10:12:24,661 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ee9a5294ca27094d33add8191e9931e9, ASSIGN 2023-07-18 10:12:24,661 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=87c0b68c675c4843c661c8529cf9af8d, ASSIGN 2023-07-18 10:12:24,662 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ee9a5294ca27094d33add8191e9931e9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34221,1689675027589; forceNewPlan=false, retain=false 2023-07-18 10:12:24,662 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=87c0b68c675c4843c661c8529cf9af8d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33757,1689675027667; forceNewPlan=false, retain=false 2023-07-18 10:12:24,812 INFO [jenkins-hbase4:46557] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-18 10:12:24,816 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=ee9a5294ca27094d33add8191e9931e9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:24,816 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=87c0b68c675c4843c661c8529cf9af8d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:24,816 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689675144511.ee9a5294ca27094d33add8191e9931e9.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689675144816"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689675144816"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689675144816"}]},"ts":"1689675144816"} 2023-07-18 10:12:24,817 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689675144511.87c0b68c675c4843c661c8529cf9af8d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689675144816"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689675144816"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689675144816"}]},"ts":"1689675144816"} 2023-07-18 10:12:24,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-18 10:12:24,821 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure ee9a5294ca27094d33add8191e9931e9, server=jenkins-hbase4.apache.org,34221,1689675027589}] 2023-07-18 10:12:24,823 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure 87c0b68c675c4843c661c8529cf9af8d, server=jenkins-hbase4.apache.org,33757,1689675027667}] 2023-07-18 10:12:24,979 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689675144511.ee9a5294ca27094d33add8191e9931e9. 2023-07-18 10:12:24,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ee9a5294ca27094d33add8191e9931e9, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689675144511.ee9a5294ca27094d33add8191e9931e9.', STARTKEY => '1', ENDKEY => ''} 2023-07-18 10:12:24,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689675144511.ee9a5294ca27094d33add8191e9931e9. service=AccessControlService 2023-07-18 10:12:24,979 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 10:12:24,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp ee9a5294ca27094d33add8191e9931e9 2023-07-18 10:12:24,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689675144511.ee9a5294ca27094d33add8191e9931e9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:12:24,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ee9a5294ca27094d33add8191e9931e9 2023-07-18 10:12:24,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ee9a5294ca27094d33add8191e9931e9 2023-07-18 10:12:24,980 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689675144511.87c0b68c675c4843c661c8529cf9af8d. 2023-07-18 10:12:24,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 87c0b68c675c4843c661c8529cf9af8d, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689675144511.87c0b68c675c4843c661c8529cf9af8d.', STARTKEY => '', ENDKEY => '1'} 2023-07-18 10:12:24,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689675144511.87c0b68c675c4843c661c8529cf9af8d. service=AccessControlService 2023-07-18 10:12:24,980 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 10:12:24,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 87c0b68c675c4843c661c8529cf9af8d 2023-07-18 10:12:24,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689675144511.87c0b68c675c4843c661c8529cf9af8d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:12:24,981 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 87c0b68c675c4843c661c8529cf9af8d 2023-07-18 10:12:24,981 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 87c0b68c675c4843c661c8529cf9af8d 2023-07-18 10:12:24,981 INFO [StoreOpener-ee9a5294ca27094d33add8191e9931e9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ee9a5294ca27094d33add8191e9931e9 2023-07-18 10:12:24,982 INFO [StoreOpener-87c0b68c675c4843c661c8529cf9af8d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 87c0b68c675c4843c661c8529cf9af8d 2023-07-18 10:12:24,983 DEBUG [StoreOpener-ee9a5294ca27094d33add8191e9931e9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithSkipTmp/ee9a5294ca27094d33add8191e9931e9/cf 2023-07-18 10:12:24,983 DEBUG [StoreOpener-ee9a5294ca27094d33add8191e9931e9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithSkipTmp/ee9a5294ca27094d33add8191e9931e9/cf 2023-07-18 10:12:24,984 DEBUG [StoreOpener-87c0b68c675c4843c661c8529cf9af8d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithSkipTmp/87c0b68c675c4843c661c8529cf9af8d/cf 2023-07-18 10:12:24,984 INFO [StoreOpener-ee9a5294ca27094d33add8191e9931e9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ee9a5294ca27094d33add8191e9931e9 columnFamilyName cf 2023-07-18 10:12:24,984 DEBUG [StoreOpener-87c0b68c675c4843c661c8529cf9af8d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithSkipTmp/87c0b68c675c4843c661c8529cf9af8d/cf 2023-07-18 10:12:24,984 INFO [StoreOpener-87c0b68c675c4843c661c8529cf9af8d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 87c0b68c675c4843c661c8529cf9af8d columnFamilyName cf 2023-07-18 10:12:24,985 INFO [StoreOpener-ee9a5294ca27094d33add8191e9931e9-1] regionserver.HStore(310): Store=ee9a5294ca27094d33add8191e9931e9/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 10:12:24,985 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithSkipTmp/ee9a5294ca27094d33add8191e9931e9 2023-07-18 10:12:24,986 INFO [StoreOpener-87c0b68c675c4843c661c8529cf9af8d-1] regionserver.HStore(310): Store=87c0b68c675c4843c661c8529cf9af8d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 10:12:24,986 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithSkipTmp/ee9a5294ca27094d33add8191e9931e9 2023-07-18 10:12:24,986 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithSkipTmp/87c0b68c675c4843c661c8529cf9af8d 2023-07-18 10:12:24,987 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithSkipTmp/87c0b68c675c4843c661c8529cf9af8d 2023-07-18 10:12:24,990 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 87c0b68c675c4843c661c8529cf9af8d 2023-07-18 10:12:24,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ee9a5294ca27094d33add8191e9931e9 2023-07-18 10:12:24,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithSkipTmp/87c0b68c675c4843c661c8529cf9af8d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 10:12:24,992 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 87c0b68c675c4843c661c8529cf9af8d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73603118, jitterRate=0.09677192568778992}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 10:12:24,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 87c0b68c675c4843c661c8529cf9af8d: 2023-07-18 10:12:24,993 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689675144511.87c0b68c675c4843c661c8529cf9af8d., pid=109, masterSystemTime=1689675144975 2023-07-18 10:12:24,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithSkipTmp/ee9a5294ca27094d33add8191e9931e9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 10:12:24,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689675144511.87c0b68c675c4843c661c8529cf9af8d. 2023-07-18 10:12:24,995 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689675144511.87c0b68c675c4843c661c8529cf9af8d. 2023-07-18 10:12:24,995 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ee9a5294ca27094d33add8191e9931e9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64403201, jitterRate=-0.04031752049922943}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 10:12:24,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ee9a5294ca27094d33add8191e9931e9: 2023-07-18 10:12:24,996 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=87c0b68c675c4843c661c8529cf9af8d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:24,996 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689675144511.ee9a5294ca27094d33add8191e9931e9., pid=108, masterSystemTime=1689675144974 2023-07-18 10:12:24,996 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689675144511.87c0b68c675c4843c661c8529cf9af8d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689675144996"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689675144996"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689675144996"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689675144996"}]},"ts":"1689675144996"} 2023-07-18 10:12:24,997 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689675144511.ee9a5294ca27094d33add8191e9931e9. 2023-07-18 10:12:24,997 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689675144511.ee9a5294ca27094d33add8191e9931e9. 2023-07-18 10:12:24,998 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=ee9a5294ca27094d33add8191e9931e9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:24,998 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689675144511.ee9a5294ca27094d33add8191e9931e9.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689675144998"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689675144998"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689675144998"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689675144998"}]},"ts":"1689675144998"} 2023-07-18 10:12:25,000 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=106 2023-07-18 10:12:25,001 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure 87c0b68c675c4843c661c8529cf9af8d, server=jenkins-hbase4.apache.org,33757,1689675027667 in 175 msec 2023-07-18 10:12:25,002 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=107 2023-07-18 10:12:25,002 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure ee9a5294ca27094d33add8191e9931e9, server=jenkins-hbase4.apache.org,34221,1689675027589 in 179 msec 2023-07-18 10:12:25,002 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=87c0b68c675c4843c661c8529cf9af8d, ASSIGN in 343 msec 2023-07-18 10:12:25,008 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=107, resume processing ppid=105 2023-07-18 10:12:25,008 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ee9a5294ca27094d33add8191e9931e9, ASSIGN in 344 msec 2023-07-18 10:12:25,008 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 10:12:25,009 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689675145008"}]},"ts":"1689675145008"} 2023-07-18 10:12:25,010 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-18 10:12:25,013 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 10:12:25,013 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-18 10:12:25,015 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34221] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-18 10:12:25,016 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:12:25,016 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:12:25,017 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:12:25,017 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:12:25,019 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-18 10:12:25,020 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-18 10:12:25,020 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-18 10:12:25,023 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-18 10:12:25,024 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 511 msec 2023-07-18 10:12:25,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-18 10:12:25,121 INFO [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-18 10:12:25,122 DEBUG [Listener at jenkins-hbase4.apache.org/42677] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithSkipTmp get assigned. Timeout = 60000ms 2023-07-18 10:12:25,122 INFO [Listener at jenkins-hbase4.apache.org/42677] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 10:12:25,130 INFO [Listener at jenkins-hbase4.apache.org/42677] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned to meta. Checking AM states. 2023-07-18 10:12:25,130 INFO [Listener at jenkins-hbase4.apache.org/42677] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 10:12:25,130 INFO [Listener at jenkins-hbase4.apache.org/42677] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned. 2023-07-18 10:12:25,133 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-18 10:12:25,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689675145133 (current time:1689675145133). 2023-07-18 10:12:25,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 10:12:25,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] zookeeper.ReadOnlyZKClient(139): Connect 0x6819fc67 to 127.0.0.1:56089 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 10:12:25,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5c4ee477, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 10:12:25,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:12:25,161 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33554, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:12:25,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6819fc67 to 127.0.0.1:56089 2023-07-18 10:12:25,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 10:12:25,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] zookeeper.ReadOnlyZKClient(139): Connect 0x1b0e6572 to 127.0.0.1:56089 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 10:12:25,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3cd348b0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 10:12:25,179 DEBUG [hconnection-0x17956e01-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:12:25,189 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33562, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:12:25,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:12:25,197 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42410, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:12:25,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1b0e6572 to 127.0.0.1:56089 2023-07-18 10:12:25,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 10:12:25,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-18 10:12:25,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 10:12:25,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-18 10:12:25,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-18 10:12:25,206 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-18 10:12:25,207 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689675745207 2023-07-18 10:12:25,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-18 10:12:25,207 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,209 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 10:12:25,209 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 10:12:25,210 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-18 10:12:25,210 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-18 10:12:25,213 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 6 msec 2023-07-18 10:12:25,214 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-18 10:12:25,215 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689675745215 2023-07-18 10:12:25,252 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,252 INFO [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-18 10:12:25,252 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:12:25,254 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-18 10:12:25,254 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-18 10:12:25,254 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,254 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,256 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:12:25,256 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:12:25,256 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:12:25,256 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:12:25,256 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:25,256 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:12:25,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:12:25,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:12:25,256 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:12:25,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:12:25,256 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:25,256 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:25,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,257 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:25,257 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 10:12:25,257 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,257 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,257 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-18 10:12:25,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,258 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-18 10:12:25,259 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,259 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-18 10:12:25,259 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:12:25,261 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-18 10:12:25,261 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-18 10:12:25,261 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34221,1689675027589' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-18 10:12:25,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-18 10:12:25,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,261 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-18 10:12:25,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-18 10:12:25,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,261 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-18 10:12:25,261 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,262 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-18 10:12:25,262 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:12:25,262 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,263 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-18 10:12:25,263 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:12:25,266 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-18 10:12:25,266 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-18 10:12:25,268 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33757,1689675027667' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-18 10:12:25,266 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-18 10:12:25,268 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-18 10:12:25,268 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40089,1689675027524' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-18 10:12:25,268 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,268 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:25,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:25,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:12:25,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:12:25,275 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,276 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:25,276 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:12:25,276 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,276 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:12:25,276 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,276 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:12:25,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:12:25,276 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,276 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:12:25,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:12:25,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:25,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:25,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:12:25,278 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34221,1689675027589' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-18 10:12:25,278 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@766695b8[Count = 1] remaining members to acquire global barrier 2023-07-18 10:12:25,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:25,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:12:25,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:12:25,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:12:25,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:12:25,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:12:25,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:25,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:25,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:12:25,281 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33757,1689675027667' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-18 10:12:25,281 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@766695b8[Count = 0] remaining members to acquire global barrier 2023-07-18 10:12:25,281 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-18 10:12:25,281 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,282 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,282 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,282 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-18 10:12:25,282 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-18 10:12:25,282 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,282 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,40089,1689675027524' in zk 2023-07-18 10:12:25,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,282 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-18 10:12:25,282 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-18 10:12:25,284 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 10:12:25,284 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 10:12:25,284 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689675144511.87c0b68c675c4843c661c8529cf9af8d. 2023-07-18 10:12:25,284 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 10:12:25,284 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689675144511.87c0b68c675c4843c661c8529cf9af8d. started... 2023-07-18 10:12:25,284 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 10:12:25,284 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:25,284 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689675144511.ee9a5294ca27094d33add8191e9931e9. 2023-07-18 10:12:25,286 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 87c0b68c675c4843c661c8529cf9af8d: 2023-07-18 10:12:25,286 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689675144511.ee9a5294ca27094d33add8191e9931e9. started... 2023-07-18 10:12:25,286 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689675144511.87c0b68c675c4843c661c8529cf9af8d.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,286 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 10:12:25,287 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ee9a5294ca27094d33add8191e9931e9: 2023-07-18 10:12:25,287 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 10:12:25,288 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689675144511.ee9a5294ca27094d33add8191e9931e9.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,288 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 10:12:25,288 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-18 10:12:25,288 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:25,288 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 10:12:25,288 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:12:25,288 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 10:12:25,288 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-18 10:12:25,309 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 10:12:25,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-18 10:12:25,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-18 10:12:25,312 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 10:12:25,331 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689675144511.87c0b68c675c4843c661c8529cf9af8d. completed. 2023-07-18 10:12:25,331 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689675144511.87c0b68c675c4843c661c8529cf9af8d. 2023-07-18 10:12:25,331 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 10:12:25,331 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 10:12:25,331 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:25,332 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-18 10:12:25,332 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,33757,1689675027667' in zk 2023-07-18 10:12:25,334 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:25,334 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-18 10:12:25,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:25,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:12:25,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:12:25,334 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:12:25,334 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-18 10:12:25,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:12:25,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:12:25,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:12:25,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:25,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:25,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:12:25,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:12:25,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:25,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,33757,1689675027667': 2023-07-18 10:12:25,341 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33757,1689675027667' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-18 10:12:25,343 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689675144511.ee9a5294ca27094d33add8191e9931e9. completed. 2023-07-18 10:12:25,343 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689675144511.ee9a5294ca27094d33add8191e9931e9. 2023-07-18 10:12:25,343 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 10:12:25,343 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 10:12:25,343 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:25,343 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-18 10:12:25,343 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,34221,1689675027589' in zk 2023-07-18 10:12:25,345 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-18 10:12:25,345 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:25,345 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:12:25,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:25,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:12:25,345 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-18 10:12:25,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:12:25,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:12:25,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:12:25,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:12:25,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:25,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:25,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:12:25,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:12:25,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:25,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:25,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,34221,1689675027589': 2023-07-18 10:12:25,352 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34221,1689675027589' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-18 10:12:25,353 INFO [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-18 10:12:25,353 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 10:12:25,353 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 10:12:25,353 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,353 INFO [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 10:12:25,355 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,355 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,355 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,355 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,355 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:12:25,355 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,355 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:12:25,355 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,356 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:12:25,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:12:25,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:12:25,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:12:25,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:12:25,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:12:25,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:12:25,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:12:25,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:12:25,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,357 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:12:25,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:12:25,358 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:25,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,358 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:25,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:12:25,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:12:25,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:25,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:25,361 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:12:25,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:12:25,361 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:25,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,362 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:25,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:12:25,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:25,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:25,373 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:12:25,373 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:12:25,373 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:12:25,373 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:12:25,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:12:25,373 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:25,373 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:12:25,374 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:12:25,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:12:25,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:12:25,373 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:12:25,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:12:25,373 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:12:25,373 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,374 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:25,374 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:12:25,374 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,374 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:25,374 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:12:25,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:12:25,375 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:25,375 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:12:25,375 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,375 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,375 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:12:25,376 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,378 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:12:25,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:12:25,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:12:25,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:12:25,379 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,424 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,495 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-18 10:12:25,495 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,495 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,495 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689675145207Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689675145378 (+171 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689675145378Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689675145383 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689675145417 (+34 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689675145494 (+77 ms) 2023-07-18 10:12:25,498 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-18 10:12:25,500 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 289 msec 2023-07-18 10:12:25,512 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 10:12:25,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-18 10:12:25,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 10:12:25,531 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33757] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689675144511.87c0b68c675c4843c661c8529cf9af8d. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 10:12:25,537 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34221] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689675144511.ee9a5294ca27094d33add8191e9931e9. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 10:12:25,562 DEBUG [Listener at jenkins-hbase4.apache.org/42677] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,562 DEBUG [Listener at jenkins-hbase4.apache.org/42677] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689675144511.87c0b68c675c4843c661c8529cf9af8d. 2023-07-18 10:12:25,562 INFO [Listener at jenkins-hbase4.apache.org/42677] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 10:12:25,602 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-18 10:12:25,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689675145603 (current time:1689675145603). 2023-07-18 10:12:25,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 10:12:25,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] zookeeper.ReadOnlyZKClient(139): Connect 0x367e3a97 to 127.0.0.1:56089 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 10:12:25,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@aa7bf3f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 10:12:25,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:12:25,624 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33570, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:12:25,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x367e3a97 to 127.0.0.1:56089 2023-07-18 10:12:25,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 10:12:25,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] zookeeper.ReadOnlyZKClient(139): Connect 0x0c90e5fa to 127.0.0.1:56089 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 10:12:25,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4bfddc7d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 10:12:25,648 DEBUG [hconnection-0x7c94cc7a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:12:25,654 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33578, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:12:25,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:12:25,665 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42426, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:12:25,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0c90e5fa to 127.0.0.1:56089 2023-07-18 10:12:25,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 10:12:25,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-18 10:12:25,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 10:12:25,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-18 10:12:25,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-18 10:12:25,672 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-18 10:12:25,673 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689675745673 2023-07-18 10:12:25,673 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-18 10:12:25,675 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-18 10:12:25,676 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-18 10:12:25,676 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 10:12:25,676 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 10:12:25,678 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 6 msec 2023-07-18 10:12:25,680 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-18 10:12:25,687 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689675745687 2023-07-18 10:12:25,700 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,700 INFO [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-18 10:12:25,700 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:12:25,702 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-18 10:12:25,702 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-18 10:12:25,703 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,703 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,706 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:12:25,706 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:12:25,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:12:25,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:12:25,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:12:25,706 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:25,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:12:25,706 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:12:25,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:12:25,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:12:25,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,707 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:25,707 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:25,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,709 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,709 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:25,709 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 10:12:25,709 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-18 10:12:25,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-18 10:12:25,709 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-18 10:12:25,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,709 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-18 10:12:25,709 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,709 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-18 10:12:25,710 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,710 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:12:25,710 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-18 10:12:25,711 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,711 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:12:25,711 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-18 10:12:25,712 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-18 10:12:25,713 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40089,1689675027524' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-18 10:12:25,713 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-18 10:12:25,713 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-18 10:12:25,713 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33757,1689675027667' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-18 10:12:25,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-18 10:12:25,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,713 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-18 10:12:25,714 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,714 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-18 10:12:25,714 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:12:25,715 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-18 10:12:25,715 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-18 10:12:25,715 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34221,1689675027589' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-18 10:12:25,716 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:25,716 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,716 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:25,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:12:25,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:12:25,716 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,716 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:12:25,716 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,716 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:12:25,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:12:25,717 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:25,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:12:25,717 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,718 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,718 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:12:25,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:25,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:12:25,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:25,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:12:25,720 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33757,1689675027667' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-18 10:12:25,720 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@746c781e[Count = 1] remaining members to acquire global barrier 2023-07-18 10:12:25,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:25,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:12:25,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:12:25,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:12:25,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:12:25,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:25,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:12:25,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:25,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:12:25,723 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34221,1689675027589' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-18 10:12:25,723 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@746c781e[Count = 0] remaining members to acquire global barrier 2023-07-18 10:12:25,723 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-18 10:12:25,723 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,730 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,730 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,730 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,730 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-18 10:12:25,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,730 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:25,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,730 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-18 10:12:25,731 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-18 10:12:25,731 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-18 10:12:25,731 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,40089,1689675027524' in zk 2023-07-18 10:12:25,731 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:25,731 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 10:12:25,732 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-18 10:12:25,732 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:12:25,732 DEBUG [member: 'jenkins-hbase4.apache.org,40089,1689675027524' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-18 10:12:25,734 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 10:12:25,736 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 10:12:25,736 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689675144511.87c0b68c675c4843c661c8529cf9af8d. 2023-07-18 10:12:25,736 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689675144511.87c0b68c675c4843c661c8529cf9af8d. started... 2023-07-18 10:12:25,736 INFO [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 87c0b68c675c4843c661c8529cf9af8d 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-18 10:12:25,740 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 10:12:25,740 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 10:12:25,740 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689675144511.ee9a5294ca27094d33add8191e9931e9. 2023-07-18 10:12:25,740 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689675144511.ee9a5294ca27094d33add8191e9931e9. started... 2023-07-18 10:12:25,740 INFO [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ee9a5294ca27094d33add8191e9931e9 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-18 10:12:25,773 INFO [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=132 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithSkipTmp/87c0b68c675c4843c661c8529cf9af8d/.tmp/cf/7753552bba9e4ba0ada782009d12b840 2023-07-18 10:12:25,775 INFO [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.13 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithSkipTmp/ee9a5294ca27094d33add8191e9931e9/.tmp/cf/d32a3d813b4c4a8baf386d2113f37490 2023-07-18 10:12:25,777 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 10:12:25,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-18 10:12:25,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-18 10:12:25,778 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 10:12:25,781 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithSkipTmp/87c0b68c675c4843c661c8529cf9af8d/.tmp/cf/7753552bba9e4ba0ada782009d12b840 as hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithSkipTmp/87c0b68c675c4843c661c8529cf9af8d/cf/7753552bba9e4ba0ada782009d12b840 2023-07-18 10:12:25,788 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithSkipTmp/ee9a5294ca27094d33add8191e9931e9/.tmp/cf/d32a3d813b4c4a8baf386d2113f37490 as hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithSkipTmp/ee9a5294ca27094d33add8191e9931e9/cf/d32a3d813b4c4a8baf386d2113f37490 2023-07-18 10:12:25,788 INFO [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithSkipTmp/87c0b68c675c4843c661c8529cf9af8d/cf/7753552bba9e4ba0ada782009d12b840, entries=2, sequenceid=6, filesize=5.0 K 2023-07-18 10:12:25,789 INFO [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 87c0b68c675c4843c661c8529cf9af8d in 53ms, sequenceid=6, compaction requested=false 2023-07-18 10:12:25,789 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-18 10:12:25,790 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 87c0b68c675c4843c661c8529cf9af8d: 2023-07-18 10:12:25,790 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689675144511.87c0b68c675c4843c661c8529cf9af8d.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,790 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 10:12:25,790 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithSkipTmp/87c0b68c675c4843c661c8529cf9af8d/cf/7753552bba9e4ba0ada782009d12b840] hfiles 2023-07-18 10:12:25,790 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithSkipTmp/87c0b68c675c4843c661c8529cf9af8d/cf/7753552bba9e4ba0ada782009d12b840 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,794 INFO [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithSkipTmp/ee9a5294ca27094d33add8191e9931e9/cf/d32a3d813b4c4a8baf386d2113f37490, entries=48, sequenceid=6, filesize=8.1 K 2023-07-18 10:12:25,796 INFO [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for ee9a5294ca27094d33add8191e9931e9 in 56ms, sequenceid=6, compaction requested=false 2023-07-18 10:12:25,808 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ee9a5294ca27094d33add8191e9931e9: 2023-07-18 10:12:25,808 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689675144511.ee9a5294ca27094d33add8191e9931e9.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,808 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 10:12:25,809 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithSkipTmp/ee9a5294ca27094d33add8191e9931e9/cf/d32a3d813b4c4a8baf386d2113f37490] hfiles 2023-07-18 10:12:25,809 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithSkipTmp/ee9a5294ca27094d33add8191e9931e9/cf/d32a3d813b4c4a8baf386d2113f37490 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,869 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689675144511.ee9a5294ca27094d33add8191e9931e9. completed. 2023-07-18 10:12:25,869 DEBUG [rs(jenkins-hbase4.apache.org,34221,1689675027589)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689675144511.ee9a5294ca27094d33add8191e9931e9. 2023-07-18 10:12:25,869 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 10:12:25,869 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 10:12:25,869 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:25,869 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-18 10:12:25,869 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,34221,1689675027589' in zk 2023-07-18 10:12:25,872 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-18 10:12:25,872 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:25,872 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:12:25,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:25,872 DEBUG [member: 'jenkins-hbase4.apache.org,34221,1689675027589' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-18 10:12:25,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:12:25,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:12:25,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:12:25,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:12:25,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:25,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:12:25,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:25,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:12:25,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:12:25,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:25,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,34221,1689675027589': 2023-07-18 10:12:25,878 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34221,1689675027589' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-18 10:12:25,978 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 10:12:25,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-18 10:12:25,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-18 10:12:25,980 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-18 10:12:26,270 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689675144511.87c0b68c675c4843c661c8529cf9af8d. completed. 2023-07-18 10:12:26,271 DEBUG [rs(jenkins-hbase4.apache.org,33757,1689675027667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689675144511.87c0b68c675c4843c661c8529cf9af8d. 2023-07-18 10:12:26,271 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 10:12:26,271 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 10:12:26,271 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:26,271 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-18 10:12:26,271 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,33757,1689675027667' in zk 2023-07-18 10:12:26,273 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-18 10:12:26,273 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:26,273 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:12:26,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:26,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:12:26,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:12:26,273 DEBUG [member: 'jenkins-hbase4.apache.org,33757,1689675027667' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-18 10:12:26,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:12:26,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:12:26,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:26,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:26,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:12:26,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:26,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:12:26,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:26,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:12:26,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:26,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:26,281 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 10:12:26,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,33757,1689675027667': 2023-07-18 10:12:26,282 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33757,1689675027667' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-18 10:12:26,282 INFO [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-18 10:12:26,282 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 10:12:26,283 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 10:12:26,283 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:26,283 INFO [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 10:12:26,286 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:26,286 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:26,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:26,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:26,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:26,286 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:12:26,286 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:26,286 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:26,286 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:12:26,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:26,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:26,286 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:12:26,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-18 10:12:26,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-18 10:12:26,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:26,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:26,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:12:26,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:12:26,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:12:26,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:12:26,287 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-18 10:12:26,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:12:26,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:12:26,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:12:26,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:12:26,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:12:26,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:26,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:26,288 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:26,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:26,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:26,289 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:12:26,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:12:26,289 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:26,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:26,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:26,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:12:26,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:26,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:12:26,291 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:12:26,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:26,291 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:26,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:12:26,292 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:26,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:26,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:26,298 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:12:26,298 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:26,299 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:12:26,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:12:26,298 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:12:26,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:12:26,299 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:26,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:12:26,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:12:26,299 DEBUG [(jenkins-hbase4.apache.org,46557,1689675026042)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:12:26,299 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:12:26,299 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:26,299 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:12:26,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:12:26,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:12:26,311 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:26,311 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:26,311 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:26,311 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:26,311 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:26,311 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:26,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:12:26,311 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:12:26,311 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:12:26,311 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:12:26,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:12:26,311 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:26,312 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:26,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:12:26,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:12:26,312 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:26,315 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:12:26,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:12:26,376 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:26,471 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-18 10:12:26,471 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:26,471 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:26,471 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689675145673Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689675146299 (+626 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689675146311 (+12 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689675146326 (+15 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689675146364 (+38 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689675146471 (+107 ms) 2023-07-18 10:12:26,475 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-18 10:12:26,478 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 802 msec 2023-07-18 10:12:26,787 DEBUG [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 10:12:26,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-18 10:12:26,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 10:12:26,789 INFO [Listener at jenkins-hbase4.apache.org/42677] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/export-test/export-1689675146789 2023-07-18 10:12:26,789 INFO [Listener at jenkins-hbase4.apache.org/42677] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35953, tgtDir=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/export-test/export-1689675146789, rawTgtDir=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/export-test/export-1689675146789, srcFsUri=hdfs://localhost:35953, srcDir=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336 2023-07-18 10:12:26,816 DEBUG [Listener at jenkins-hbase4.apache.org/42677] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35953, inputRoot=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336 2023-07-18 10:12:26,816 DEBUG [Listener at jenkins-hbase4.apache.org/42677] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1205182776_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/export-test/export-1689675146789, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/export-test/export-1689675146789/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:26,816 INFO [Listener at jenkins-hbase4.apache.org/42677] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35953, inputRoot=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336, snapshotDir=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-18 10:12:26,841 INFO [Listener at jenkins-hbase4.apache.org/42677] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/export-test/export-1689675146789/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:26,925 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-18 10:12:26,925 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-18 10:12:26,926 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-18 10:12:26,926 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-18 10:12:26,926 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-18 10:12:26,927 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-18 10:12:26,927 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-18 10:12:27,011 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/hadoop-8026189314255130286.jar 2023-07-18 10:12:27,012 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-18 10:12:27,013 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-18 10:12:27,013 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-18 10:12:27,013 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-18 10:12:27,014 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-18 10:12:27,014 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-18 10:12:27,015 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-18 10:12:27,016 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-18 10:12:27,016 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-18 10:12:27,017 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-18 10:12:27,017 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-18 10:12:27,018 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-18 10:12:27,018 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-18 10:12:27,019 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-18 10:12:27,019 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-18 10:12:27,020 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-18 10:12:27,021 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 10:12:27,021 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 10:12:27,022 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 10:12:27,022 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 10:12:27,022 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 10:12:27,023 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 10:12:27,023 DEBUG [Listener at jenkins-hbase4.apache.org/42677] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 10:12:28,168 WARN [Listener at jenkins-hbase4.apache.org/42677] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-18 10:12:28,171 INFO [Listener at jenkins-hbase4.apache.org/42677] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-18 10:12:28,173 DEBUG [Listener at jenkins-hbase4.apache.org/42677] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-18 10:12:29,036 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 10:12:29,037 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 10:12:29,039 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689675035639_0006_000001 (auth:SIMPLE) 2023-07-18 10:12:29,539 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689675035639_0007_000001 (auth:SIMPLE) 2023-07-18 10:12:29,824 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-18 10:12:36,060 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689675035639_0007_000001 (auth:SIMPLE) 2023-07-18 10:12:38,380 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689675035639_0007_000001 (auth:SIMPLE) 2023-07-18 10:12:42,292 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689675035639_0007_000001 (auth:SIMPLE) 2023-07-18 10:12:43,396 INFO [Listener at jenkins-hbase4.apache.org/42677] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-18 10:12:43,396 INFO [Listener at jenkins-hbase4.apache.org/42677] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-18 10:12:43,414 INFO [Listener at jenkins-hbase4.apache.org/42677] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:43,414 INFO [Listener at jenkins-hbase4.apache.org/42677] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-18 10:12:43,415 INFO [Listener at jenkins-hbase4.apache.org/42677] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-18 10:12:43,415 DEBUG [Listener at jenkins-hbase4.apache.org/42677] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1314676217_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:43,415 DEBUG [Listener at jenkins-hbase4.apache.org/42677] snapshot.TestExportSnapshot(367): hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-18 10:12:43,415 DEBUG [Listener at jenkins-hbase4.apache.org/42677] snapshot.TestExportSnapshot(367): hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-18 10:12:43,415 DEBUG [Listener at jenkins-hbase4.apache.org/42677] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1314676217_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/export-test/export-1689675146789/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/export-test/export-1689675146789/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:43,416 DEBUG [Listener at jenkins-hbase4.apache.org/42677] snapshot.TestExportSnapshot(367): hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/export-test/export-1689675146789/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-18 10:12:43,416 DEBUG [Listener at jenkins-hbase4.apache.org/42677] snapshot.TestExportSnapshot(367): hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/export-test/export-1689675146789/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-18 10:12:43,423 INFO [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:43,423 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:43,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:43,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-18 10:12:43,429 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689675163429"}]},"ts":"1689675163429"} 2023-07-18 10:12:43,431 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-18 10:12:43,433 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-18 10:12:43,433 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=87c0b68c675c4843c661c8529cf9af8d, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ee9a5294ca27094d33add8191e9931e9, UNASSIGN}] 2023-07-18 10:12:43,437 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=87c0b68c675c4843c661c8529cf9af8d, UNASSIGN 2023-07-18 10:12:43,437 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ee9a5294ca27094d33add8191e9931e9, UNASSIGN 2023-07-18 10:12:43,437 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=87c0b68c675c4843c661c8529cf9af8d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:12:43,438 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=ee9a5294ca27094d33add8191e9931e9, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:12:43,438 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689675144511.87c0b68c675c4843c661c8529cf9af8d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689675163437"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689675163437"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689675163437"}]},"ts":"1689675163437"} 2023-07-18 10:12:43,438 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689675144511.ee9a5294ca27094d33add8191e9931e9.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689675163438"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689675163438"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689675163438"}]},"ts":"1689675163438"} 2023-07-18 10:12:43,439 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure 87c0b68c675c4843c661c8529cf9af8d, server=jenkins-hbase4.apache.org,33757,1689675027667}] 2023-07-18 10:12:43,440 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure ee9a5294ca27094d33add8191e9931e9, server=jenkins-hbase4.apache.org,34221,1689675027589}] 2023-07-18 10:12:43,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-18 10:12:43,593 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ee9a5294ca27094d33add8191e9931e9 2023-07-18 10:12:43,593 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 87c0b68c675c4843c661c8529cf9af8d 2023-07-18 10:12:43,593 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ee9a5294ca27094d33add8191e9931e9, disabling compactions & flushes 2023-07-18 10:12:43,593 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689675144511.ee9a5294ca27094d33add8191e9931e9. 2023-07-18 10:12:43,593 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689675144511.ee9a5294ca27094d33add8191e9931e9. 2023-07-18 10:12:43,594 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689675144511.ee9a5294ca27094d33add8191e9931e9. after waiting 0 ms 2023-07-18 10:12:43,594 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 87c0b68c675c4843c661c8529cf9af8d, disabling compactions & flushes 2023-07-18 10:12:43,594 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689675144511.ee9a5294ca27094d33add8191e9931e9. 2023-07-18 10:12:43,594 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689675144511.87c0b68c675c4843c661c8529cf9af8d. 2023-07-18 10:12:43,594 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689675144511.87c0b68c675c4843c661c8529cf9af8d. 2023-07-18 10:12:43,594 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689675144511.87c0b68c675c4843c661c8529cf9af8d. after waiting 0 ms 2023-07-18 10:12:43,594 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689675144511.87c0b68c675c4843c661c8529cf9af8d. 2023-07-18 10:12:43,607 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithSkipTmp/87c0b68c675c4843c661c8529cf9af8d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 10:12:43,608 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/default/testtb-testExportFileSystemStateWithSkipTmp/ee9a5294ca27094d33add8191e9931e9/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 10:12:43,608 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 10:12:43,609 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689675144511.87c0b68c675c4843c661c8529cf9af8d. 2023-07-18 10:12:43,610 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 87c0b68c675c4843c661c8529cf9af8d: 2023-07-18 10:12:43,610 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 10:12:43,611 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689675144511.ee9a5294ca27094d33add8191e9931e9. 2023-07-18 10:12:43,611 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ee9a5294ca27094d33add8191e9931e9: 2023-07-18 10:12:43,612 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 87c0b68c675c4843c661c8529cf9af8d 2023-07-18 10:12:43,613 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=87c0b68c675c4843c661c8529cf9af8d, regionState=CLOSED 2023-07-18 10:12:43,613 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689675144511.87c0b68c675c4843c661c8529cf9af8d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689675163612"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689675163612"}]},"ts":"1689675163612"} 2023-07-18 10:12:43,613 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ee9a5294ca27094d33add8191e9931e9 2023-07-18 10:12:43,613 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=ee9a5294ca27094d33add8191e9931e9, regionState=CLOSED 2023-07-18 10:12:43,613 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689675144511.ee9a5294ca27094d33add8191e9931e9.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689675163613"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689675163613"}]},"ts":"1689675163613"} 2023-07-18 10:12:43,617 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=115 2023-07-18 10:12:43,617 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure 87c0b68c675c4843c661c8529cf9af8d, server=jenkins-hbase4.apache.org,33757,1689675027667 in 176 msec 2023-07-18 10:12:43,617 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-07-18 10:12:43,617 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure ee9a5294ca27094d33add8191e9931e9, server=jenkins-hbase4.apache.org,34221,1689675027589 in 175 msec 2023-07-18 10:12:43,618 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=87c0b68c675c4843c661c8529cf9af8d, UNASSIGN in 184 msec 2023-07-18 10:12:43,619 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=116, resume processing ppid=114 2023-07-18 10:12:43,619 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ee9a5294ca27094d33add8191e9931e9, UNASSIGN in 184 msec 2023-07-18 10:12:43,619 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689675163619"}]},"ts":"1689675163619"} 2023-07-18 10:12:43,620 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-18 10:12:43,622 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-18 10:12:43,623 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 199 msec 2023-07-18 10:12:43,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-18 10:12:43,732 INFO [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-18 10:12:43,739 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:43,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:43,745 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:43,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:43,746 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:43,747 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34221] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:43,751 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:43,751 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:43,751 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:43,751 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:43,752 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-18 10:12:43,752 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-18 10:12:43,752 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-18 10:12:43,753 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-18 10:12:43,754 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:43,754 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:12:43,754 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:43,754 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:12:43,754 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:43,754 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:12:43,754 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:43,754 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:12:43,755 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/87c0b68c675c4843c661c8529cf9af8d 2023-07-18 10:12:43,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-18 10:12:43,758 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ee9a5294ca27094d33add8191e9931e9 2023-07-18 10:12:43,761 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/87c0b68c675c4843c661c8529cf9af8d/cf, FileablePath, hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/87c0b68c675c4843c661c8529cf9af8d/recovered.edits] 2023-07-18 10:12:43,762 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ee9a5294ca27094d33add8191e9931e9/cf, FileablePath, hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ee9a5294ca27094d33add8191e9931e9/recovered.edits] 2023-07-18 10:12:43,766 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/87c0b68c675c4843c661c8529cf9af8d/cf/7753552bba9e4ba0ada782009d12b840 to hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/87c0b68c675c4843c661c8529cf9af8d/cf/7753552bba9e4ba0ada782009d12b840 2023-07-18 10:12:43,769 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ee9a5294ca27094d33add8191e9931e9/cf/d32a3d813b4c4a8baf386d2113f37490 to hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/ee9a5294ca27094d33add8191e9931e9/cf/d32a3d813b4c4a8baf386d2113f37490 2023-07-18 10:12:43,770 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/87c0b68c675c4843c661c8529cf9af8d/recovered.edits/9.seqid to hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/87c0b68c675c4843c661c8529cf9af8d/recovered.edits/9.seqid 2023-07-18 10:12:43,771 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/87c0b68c675c4843c661c8529cf9af8d 2023-07-18 10:12:43,773 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ee9a5294ca27094d33add8191e9931e9/recovered.edits/9.seqid to hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/ee9a5294ca27094d33add8191e9931e9/recovered.edits/9.seqid 2023-07-18 10:12:43,774 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ee9a5294ca27094d33add8191e9931e9 2023-07-18 10:12:43,774 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-18 10:12:43,776 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:43,781 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-18 10:12:43,785 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-18 10:12:43,786 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:43,786 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-18 10:12:43,786 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689675144511.87c0b68c675c4843c661c8529cf9af8d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689675163786"}]},"ts":"9223372036854775807"} 2023-07-18 10:12:43,787 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689675144511.ee9a5294ca27094d33add8191e9931e9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689675163786"}]},"ts":"9223372036854775807"} 2023-07-18 10:12:43,809 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-18 10:12:43,809 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 87c0b68c675c4843c661c8529cf9af8d, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689675144511.87c0b68c675c4843c661c8529cf9af8d.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => ee9a5294ca27094d33add8191e9931e9, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689675144511.ee9a5294ca27094d33add8191e9931e9.', STARTKEY => '1', ENDKEY => ''}] 2023-07-18 10:12:43,809 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-18 10:12:43,809 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689675163809"}]},"ts":"9223372036854775807"} 2023-07-18 10:12:43,811 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-18 10:12:43,813 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:43,814 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 74 msec 2023-07-18 10:12:43,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-18 10:12:43,856 INFO [Listener at jenkins-hbase4.apache.org/42677] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-18 10:12:43,864 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-18 10:12:43,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:43,868 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-18 10:12:43,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46557] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:43,897 INFO [Listener at jenkins-hbase4.apache.org/42677] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=763 (was 764), OpenFileDescriptor=900 (was 909), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=649 (was 590) - SystemLoadAverage LEAK? -, ProcessCount=184 (was 184), AvailableMemoryMB=1494 (was 1700) 2023-07-18 10:12:43,898 WARN [Listener at jenkins-hbase4.apache.org/42677] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-18 10:12:43,898 INFO [Listener at jenkins-hbase4.apache.org/42677] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-18 10:12:43,910 INFO [Listener at jenkins-hbase4.apache.org/42677] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-18 10:12:48,475 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689675035639_0007_000001 (auth:SIMPLE) 2023-07-18 10:12:49,185 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-18 10:12:58,043 INFO [Listener at jenkins-hbase4.apache.org/42677] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-18 10:13:12,162 ERROR [Thread[Thread-409,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-18 10:13:12,163 INFO [Listener at jenkins-hbase4.apache.org/42677] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-18 10:13:12,273 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-18 10:13:12,285 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-18 10:13:12,286 ERROR [Thread[Thread-419,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-18 10:13:12,299 INFO [Listener at jenkins-hbase4.apache.org/42677] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-18 10:13:12,402 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-18 10:13:12,403 INFO [Listener at jenkins-hbase4.apache.org/42677] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-18 10:13:12,403 INFO [Listener at jenkins-hbase4.apache.org/42677] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-18 10:13:12,403 INFO [Listener at jenkins-hbase4.apache.org/42677] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-18 10:13:12,403 DEBUG [Listener at jenkins-hbase4.apache.org/42677] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4d69ecc8 to 127.0.0.1:56089 2023-07-18 10:13:12,403 DEBUG [Listener at jenkins-hbase4.apache.org/42677] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 10:13:12,403 DEBUG [Listener at jenkins-hbase4.apache.org/42677] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-18 10:13:12,403 DEBUG [Listener at jenkins-hbase4.apache.org/42677] util.JVMClusterUtil(257): Found active master hash=1355779610, stopped=false 2023-07-18 10:13:12,404 DEBUG [Listener at jenkins-hbase4.apache.org/42677] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 10:13:12,404 DEBUG [Listener at jenkins-hbase4.apache.org/42677] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-18 10:13:12,404 INFO [Listener at jenkins-hbase4.apache.org/42677] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,46557,1689675026042 2023-07-18 10:13:12,406 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-18 10:13:12,406 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-18 10:13:12,406 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-18 10:13:12,406 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 10:13:12,406 INFO [Listener at jenkins-hbase4.apache.org/42677] procedure2.ProcedureExecutor(629): Stopping 2023-07-18 10:13:12,406 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-18 10:13:12,407 DEBUG [Listener at jenkins-hbase4.apache.org/42677] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6004cd9c to 127.0.0.1:56089 2023-07-18 10:13:12,407 DEBUG [Listener at jenkins-hbase4.apache.org/42677] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 10:13:12,407 INFO [Listener at jenkins-hbase4.apache.org/42677] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,40089,1689675027524' ***** 2023-07-18 10:13:12,407 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 10:13:12,407 INFO [RS:1;jenkins-hbase4:34221] regionserver.HRegionServer(1064): Closing user regions 2023-07-18 10:13:12,407 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 10:13:12,407 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 10:13:12,407 INFO [RS:0;jenkins-hbase4:40089] regionserver.HRegionServer(1064): Closing user regions 2023-07-18 10:13:12,407 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 10:13:12,407 INFO [RS:2;jenkins-hbase4:33757] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,33757,1689675027667' ***** 2023-07-18 10:13:12,408 DEBUG [RS:2;jenkins-hbase4:33757] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 10:13:12,408 INFO [RS:1;jenkins-hbase4:34221] regionserver.HRegionServer(3305): Received CLOSE for d12cce108623bd7aaeb840f9208d7c33 2023-07-18 10:13:12,408 DEBUG [Listener at jenkins-hbase4.apache.org/42677] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 10:13:12,408 INFO [RS:2;jenkins-hbase4:33757] regionserver.HRegionServer(2311): STOPPED: Exiting; cluster shutdown set and not carrying any regions 2023-07-18 10:13:12,408 INFO [Listener at jenkins-hbase4.apache.org/42677] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-18 10:13:12,408 INFO [Listener at jenkins-hbase4.apache.org/42677] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,34221,1689675027589' ***** 2023-07-18 10:13:12,408 INFO [RS:1;jenkins-hbase4:34221] regionserver.HRegionServer(3305): Received CLOSE for 6d59a9d97afe79d21eaa1866a4004a5e 2023-07-18 10:13:12,408 DEBUG [Listener at jenkins-hbase4.apache.org/42677] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 10:13:12,408 INFO [Listener at jenkins-hbase4.apache.org/42677] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-18 10:13:12,408 INFO [RS:0;jenkins-hbase4:40089] regionserver.HeapMemoryManager(220): Stopping 2023-07-18 10:13:12,408 INFO [RS:2;jenkins-hbase4:33757] regionserver.HeapMemoryManager(220): Stopping 2023-07-18 10:13:12,410 INFO [RS:2;jenkins-hbase4:33757] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-18 10:13:12,410 INFO [RS:2;jenkins-hbase4:33757] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-18 10:13:12,410 INFO [RS:2;jenkins-hbase4:33757] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:13:12,410 INFO [RS:1;jenkins-hbase4:34221] regionserver.HeapMemoryManager(220): Stopping 2023-07-18 10:13:12,410 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-18 10:13:12,410 INFO [RS:1;jenkins-hbase4:34221] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-18 10:13:12,410 INFO [RS:1;jenkins-hbase4:34221] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-18 10:13:12,410 INFO [RS:0;jenkins-hbase4:40089] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-18 10:13:12,410 INFO [RS:1;jenkins-hbase4:34221] regionserver.HRegionServer(3307): Received CLOSE for the region: d12cce108623bd7aaeb840f9208d7c33, which we are already trying to CLOSE, but not completed yet 2023-07-18 10:13:12,410 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d12cce108623bd7aaeb840f9208d7c33, disabling compactions & flushes 2023-07-18 10:13:12,411 INFO [RS:1;jenkins-hbase4:34221] regionserver.HRegionServer(3307): Received CLOSE for the region: 6d59a9d97afe79d21eaa1866a4004a5e, which we are already trying to CLOSE, but not completed yet 2023-07-18 10:13:12,411 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689675030404.d12cce108623bd7aaeb840f9208d7c33. 2023-07-18 10:13:12,410 INFO [RS:0;jenkins-hbase4:40089] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-18 10:13:12,410 DEBUG [RS:2;jenkins-hbase4:33757] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x17494da9 to 127.0.0.1:56089 2023-07-18 10:13:12,411 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-18 10:13:12,410 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-18 10:13:12,411 DEBUG [RS:2;jenkins-hbase4:33757] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 10:13:12,411 INFO [RS:0;jenkins-hbase4:40089] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:13:12,414 INFO [RS:2;jenkins-hbase4:33757] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,33757,1689675027667; all regions closed. 2023-07-18 10:13:12,414 DEBUG [RS:0;jenkins-hbase4:40089] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1acfb8be to 127.0.0.1:56089 2023-07-18 10:13:12,414 DEBUG [RS:0;jenkins-hbase4:40089] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 10:13:12,411 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689675030404.d12cce108623bd7aaeb840f9208d7c33. 2023-07-18 10:13:12,414 INFO [RS:0;jenkins-hbase4:40089] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-18 10:13:12,411 INFO [RS:1;jenkins-hbase4:34221] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:13:12,414 INFO [RS:0;jenkins-hbase4:40089] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-18 10:13:12,414 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689675030404.d12cce108623bd7aaeb840f9208d7c33. after waiting 0 ms 2023-07-18 10:13:12,415 INFO [RS:0;jenkins-hbase4:40089] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-18 10:13:12,414 DEBUG [RS:1;jenkins-hbase4:34221] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x480f68d1 to 127.0.0.1:56089 2023-07-18 10:13:12,415 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689675030404.d12cce108623bd7aaeb840f9208d7c33. 2023-07-18 10:13:12,415 INFO [RS:0;jenkins-hbase4:40089] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-18 10:13:12,415 DEBUG [RS:1;jenkins-hbase4:34221] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 10:13:12,415 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing d12cce108623bd7aaeb840f9208d7c33 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-18 10:13:12,416 INFO [RS:1;jenkins-hbase4:34221] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-18 10:13:12,416 DEBUG [RS:1;jenkins-hbase4:34221] regionserver.HRegionServer(1478): Online Regions={d12cce108623bd7aaeb840f9208d7c33=hbase:namespace,,1689675030404.d12cce108623bd7aaeb840f9208d7c33., 6d59a9d97afe79d21eaa1866a4004a5e=hbase:acl,,1689675031272.6d59a9d97afe79d21eaa1866a4004a5e.} 2023-07-18 10:13:12,417 DEBUG [RS:1;jenkins-hbase4:34221] regionserver.HRegionServer(1504): Waiting on 6d59a9d97afe79d21eaa1866a4004a5e, d12cce108623bd7aaeb840f9208d7c33 2023-07-18 10:13:12,421 INFO [RS:0;jenkins-hbase4:40089] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-18 10:13:12,421 DEBUG [RS:0;jenkins-hbase4:40089] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-07-18 10:13:12,422 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-18 10:13:12,422 DEBUG [RS:0;jenkins-hbase4:40089] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-18 10:13:12,422 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-18 10:13:12,422 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-18 10:13:12,422 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-18 10:13:12,422 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-18 10:13:12,425 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-18 10:13:12,443 DEBUG [RS:2;jenkins-hbase4:33757] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/oldWALs 2023-07-18 10:13:12,443 INFO [RS:2;jenkins-hbase4:33757] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33757%2C1689675027667:(num 1689675029881) 2023-07-18 10:13:12,443 DEBUG [RS:2;jenkins-hbase4:33757] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 10:13:12,443 INFO [RS:2;jenkins-hbase4:33757] regionserver.LeaseManager(133): Closed leases 2023-07-18 10:13:12,450 INFO [RS:2;jenkins-hbase4:33757] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-18 10:13:12,451 INFO [RS:2;jenkins-hbase4:33757] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-18 10:13:12,452 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-18 10:13:12,452 INFO [RS:2;jenkins-hbase4:33757] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-18 10:13:12,452 INFO [RS:2;jenkins-hbase4:33757] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-18 10:13:12,452 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-18 10:13:12,456 INFO [RS:2;jenkins-hbase4:33757] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33757 2023-07-18 10:13:12,461 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-18 10:13:12,462 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:13:12,462 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 10:13:12,462 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 10:13:12,462 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:13:12,462 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33757,1689675027667 2023-07-18 10:13:12,463 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 10:13:12,463 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 10:13:12,464 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,33757,1689675027667] 2023-07-18 10:13:12,465 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,33757,1689675027667; numProcessing=1 2023-07-18 10:13:12,466 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,33757,1689675027667 already deleted, retry=false 2023-07-18 10:13:12,466 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,33757,1689675027667 expired; onlineServers=2 2023-07-18 10:13:12,483 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-18 10:13:12,565 INFO [RS:2;jenkins-hbase4:33757] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,33757,1689675027667; zookeeper connection closed. 2023-07-18 10:13:12,565 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 10:13:12,565 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33757-0x10177e94dcb0003, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 10:13:12,568 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@10cd7859] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@10cd7859 2023-07-18 10:13:12,617 DEBUG [RS:1;jenkins-hbase4:34221] regionserver.HRegionServer(1504): Waiting on 6d59a9d97afe79d21eaa1866a4004a5e, d12cce108623bd7aaeb840f9208d7c33 2023-07-18 10:13:12,622 DEBUG [RS:0;jenkins-hbase4:40089] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-18 10:13:12,722 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-18 10:13:12,722 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-18 10:13:12,729 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-18 10:13:12,729 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-18 10:13:12,817 DEBUG [RS:1;jenkins-hbase4:34221] regionserver.HRegionServer(1504): Waiting on 6d59a9d97afe79d21eaa1866a4004a5e, d12cce108623bd7aaeb840f9208d7c33 2023-07-18 10:13:12,822 DEBUG [RS:0;jenkins-hbase4:40089] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-18 10:13:12,858 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/hbase/namespace/d12cce108623bd7aaeb840f9208d7c33/.tmp/info/38f89a1332ee4ec88b1e26c35938ed3d 2023-07-18 10:13:12,860 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/hbase/meta/1588230740/.tmp/info/3da40beed29c4e44bfdfffddc2782c08 2023-07-18 10:13:12,865 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/hbase/namespace/d12cce108623bd7aaeb840f9208d7c33/.tmp/info/38f89a1332ee4ec88b1e26c35938ed3d as hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/hbase/namespace/d12cce108623bd7aaeb840f9208d7c33/info/38f89a1332ee4ec88b1e26c35938ed3d 2023-07-18 10:13:12,872 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3da40beed29c4e44bfdfffddc2782c08 2023-07-18 10:13:12,884 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/hbase/namespace/d12cce108623bd7aaeb840f9208d7c33/info/38f89a1332ee4ec88b1e26c35938ed3d, entries=2, sequenceid=6, filesize=4.8 K 2023-07-18 10:13:12,885 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for d12cce108623bd7aaeb840f9208d7c33 in 470ms, sequenceid=6, compaction requested=false 2023-07-18 10:13:12,896 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/hbase/namespace/d12cce108623bd7aaeb840f9208d7c33/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 10:13:12,896 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 10:13:12,897 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689675030404.d12cce108623bd7aaeb840f9208d7c33. 2023-07-18 10:13:12,897 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d12cce108623bd7aaeb840f9208d7c33: 2023-07-18 10:13:12,897 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689675030404.d12cce108623bd7aaeb840f9208d7c33. 2023-07-18 10:13:12,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6d59a9d97afe79d21eaa1866a4004a5e, disabling compactions & flushes 2023-07-18 10:13:12,898 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689675031272.6d59a9d97afe79d21eaa1866a4004a5e. 2023-07-18 10:13:12,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689675031272.6d59a9d97afe79d21eaa1866a4004a5e. 2023-07-18 10:13:12,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689675031272.6d59a9d97afe79d21eaa1866a4004a5e. after waiting 0 ms 2023-07-18 10:13:12,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689675031272.6d59a9d97afe79d21eaa1866a4004a5e. 2023-07-18 10:13:12,898 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 6d59a9d97afe79d21eaa1866a4004a5e 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-18 10:13:12,898 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/hbase/meta/1588230740/.tmp/rep_barrier/40f3508e811744e49e63fcd6c2a636e4 2023-07-18 10:13:12,903 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 40f3508e811744e49e63fcd6c2a636e4 2023-07-18 10:13:12,911 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/hbase/acl/6d59a9d97afe79d21eaa1866a4004a5e/.tmp/l/7b1189a9ddea4d9cbeb91c20ea3db09b 2023-07-18 10:13:12,914 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/hbase/meta/1588230740/.tmp/table/ad64fc185e734660b1d032b0d5375904 2023-07-18 10:13:12,916 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7b1189a9ddea4d9cbeb91c20ea3db09b 2023-07-18 10:13:12,917 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/hbase/acl/6d59a9d97afe79d21eaa1866a4004a5e/.tmp/l/7b1189a9ddea4d9cbeb91c20ea3db09b as hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/hbase/acl/6d59a9d97afe79d21eaa1866a4004a5e/l/7b1189a9ddea4d9cbeb91c20ea3db09b 2023-07-18 10:13:12,918 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ad64fc185e734660b1d032b0d5375904 2023-07-18 10:13:12,919 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/hbase/meta/1588230740/.tmp/info/3da40beed29c4e44bfdfffddc2782c08 as hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/hbase/meta/1588230740/info/3da40beed29c4e44bfdfffddc2782c08 2023-07-18 10:13:12,921 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7b1189a9ddea4d9cbeb91c20ea3db09b 2023-07-18 10:13:12,921 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/hbase/acl/6d59a9d97afe79d21eaa1866a4004a5e/l/7b1189a9ddea4d9cbeb91c20ea3db09b, entries=7, sequenceid=18, filesize=5.2 K 2023-07-18 10:13:12,922 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 6d59a9d97afe79d21eaa1866a4004a5e in 24ms, sequenceid=18, compaction requested=false 2023-07-18 10:13:12,926 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3da40beed29c4e44bfdfffddc2782c08 2023-07-18 10:13:12,926 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/hbase/meta/1588230740/info/3da40beed29c4e44bfdfffddc2782c08, entries=48, sequenceid=131, filesize=10.3 K 2023-07-18 10:13:12,927 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/hbase/meta/1588230740/.tmp/rep_barrier/40f3508e811744e49e63fcd6c2a636e4 as hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/hbase/meta/1588230740/rep_barrier/40f3508e811744e49e63fcd6c2a636e4 2023-07-18 10:13:12,928 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/hbase/acl/6d59a9d97afe79d21eaa1866a4004a5e/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-18 10:13:12,928 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 10:13:12,929 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689675031272.6d59a9d97afe79d21eaa1866a4004a5e. 2023-07-18 10:13:12,929 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6d59a9d97afe79d21eaa1866a4004a5e: 2023-07-18 10:13:12,929 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689675031272.6d59a9d97afe79d21eaa1866a4004a5e. 2023-07-18 10:13:12,931 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 40f3508e811744e49e63fcd6c2a636e4 2023-07-18 10:13:12,931 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/hbase/meta/1588230740/rep_barrier/40f3508e811744e49e63fcd6c2a636e4, entries=13, sequenceid=131, filesize=6.4 K 2023-07-18 10:13:12,932 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/hbase/meta/1588230740/.tmp/table/ad64fc185e734660b1d032b0d5375904 as hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/hbase/meta/1588230740/table/ad64fc185e734660b1d032b0d5375904 2023-07-18 10:13:12,937 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ad64fc185e734660b1d032b0d5375904 2023-07-18 10:13:12,937 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/hbase/meta/1588230740/table/ad64fc185e734660b1d032b0d5375904, entries=24, sequenceid=131, filesize=6.9 K 2023-07-18 10:13:12,937 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 515ms, sequenceid=131, compaction requested=false 2023-07-18 10:13:12,948 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-18 10:13:12,948 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 10:13:12,949 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-18 10:13:12,949 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-18 10:13:12,949 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-18 10:13:12,949 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-18 10:13:13,017 INFO [RS:1;jenkins-hbase4:34221] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,34221,1689675027589; all regions closed. 2023-07-18 10:13:13,023 INFO [RS:0;jenkins-hbase4:40089] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,40089,1689675027524; all regions closed. 2023-07-18 10:13:13,025 DEBUG [RS:1;jenkins-hbase4:34221] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/oldWALs 2023-07-18 10:13:13,025 INFO [RS:1;jenkins-hbase4:34221] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34221%2C1689675027589:(num 1689675029873) 2023-07-18 10:13:13,026 DEBUG [RS:1;jenkins-hbase4:34221] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 10:13:13,026 INFO [RS:1;jenkins-hbase4:34221] regionserver.LeaseManager(133): Closed leases 2023-07-18 10:13:13,026 INFO [RS:1;jenkins-hbase4:34221] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-18 10:13:13,027 INFO [RS:1;jenkins-hbase4:34221] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-18 10:13:13,027 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-18 10:13:13,027 INFO [RS:1;jenkins-hbase4:34221] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-18 10:13:13,027 INFO [RS:1;jenkins-hbase4:34221] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-18 10:13:13,028 INFO [RS:1;jenkins-hbase4:34221] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34221 2023-07-18 10:13:13,031 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:13:13,031 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34221,1689675027589 2023-07-18 10:13:13,031 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 10:13:13,037 DEBUG [RS:0;jenkins-hbase4:40089] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/oldWALs 2023-07-18 10:13:13,037 INFO [RS:0;jenkins-hbase4:40089] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40089%2C1689675027524.meta:.meta(num 1689675030046) 2023-07-18 10:13:13,038 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34221,1689675027589] 2023-07-18 10:13:13,038 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34221,1689675027589; numProcessing=2 2023-07-18 10:13:13,042 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34221,1689675027589 already deleted, retry=false 2023-07-18 10:13:13,042 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34221,1689675027589 expired; onlineServers=1 2023-07-18 10:13:13,044 DEBUG [RS:0;jenkins-hbase4:40089] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/oldWALs 2023-07-18 10:13:13,044 INFO [RS:0;jenkins-hbase4:40089] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40089%2C1689675027524:(num 1689675029873) 2023-07-18 10:13:13,044 DEBUG [RS:0;jenkins-hbase4:40089] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 10:13:13,045 INFO [RS:0;jenkins-hbase4:40089] regionserver.LeaseManager(133): Closed leases 2023-07-18 10:13:13,045 INFO [RS:0;jenkins-hbase4:40089] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-18 10:13:13,045 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-18 10:13:13,046 INFO [RS:0;jenkins-hbase4:40089] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40089 2023-07-18 10:13:13,048 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40089,1689675027524 2023-07-18 10:13:13,048 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 10:13:13,049 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40089,1689675027524] 2023-07-18 10:13:13,050 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40089,1689675027524; numProcessing=3 2023-07-18 10:13:13,051 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40089,1689675027524 already deleted, retry=false 2023-07-18 10:13:13,051 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40089,1689675027524 expired; onlineServers=0 2023-07-18 10:13:13,051 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,46557,1689675026042' ***** 2023-07-18 10:13:13,051 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-18 10:13:13,051 DEBUG [M:0;jenkins-hbase4:46557] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@11f28421, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-18 10:13:13,051 INFO [M:0;jenkins-hbase4:46557] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,46557,1689675026042 2023-07-18 10:13:13,051 INFO [M:0;jenkins-hbase4:46557] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,46557,1689675026042; all regions closed. 2023-07-18 10:13:13,051 DEBUG [M:0;jenkins-hbase4:46557] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 10:13:13,051 DEBUG [M:0;jenkins-hbase4:46557] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-18 10:13:13,052 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-18 10:13:13,052 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689675029377] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689675029377,5,FailOnTimeoutGroup] 2023-07-18 10:13:13,052 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689675029378] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689675029378,5,FailOnTimeoutGroup] 2023-07-18 10:13:13,052 DEBUG [M:0;jenkins-hbase4:46557] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-18 10:13:13,052 INFO [M:0;jenkins-hbase4:46557] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-18 10:13:13,052 INFO [M:0;jenkins-hbase4:46557] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-18 10:13:13,052 INFO [M:0;jenkins-hbase4:46557] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-18 10:13:13,052 DEBUG [M:0;jenkins-hbase4:46557] master.HMaster(1512): Stopping service threads 2023-07-18 10:13:13,052 INFO [M:0;jenkins-hbase4:46557] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-18 10:13:13,052 ERROR [M:0;jenkins-hbase4:46557] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-18 10:13:13,053 INFO [M:0;jenkins-hbase4:46557] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-18 10:13:13,053 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-18 10:13:13,054 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-18 10:13:13,054 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 10:13:13,054 DEBUG [M:0;jenkins-hbase4:46557] zookeeper.ZKUtil(398): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-18 10:13:13,054 WARN [M:0;jenkins-hbase4:46557] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-18 10:13:13,054 INFO [M:0;jenkins-hbase4:46557] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-18 10:13:13,054 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-18 10:13:13,054 INFO [M:0;jenkins-hbase4:46557] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-18 10:13:13,054 DEBUG [M:0;jenkins-hbase4:46557] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-18 10:13:13,055 INFO [M:0;jenkins-hbase4:46557] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 10:13:13,055 DEBUG [M:0;jenkins-hbase4:46557] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 10:13:13,055 DEBUG [M:0;jenkins-hbase4:46557] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-18 10:13:13,055 DEBUG [M:0;jenkins-hbase4:46557] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 10:13:13,055 INFO [M:0;jenkins-hbase4:46557] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=373.39 KB heapSize=449.63 KB 2023-07-18 10:13:13,075 INFO [M:0;jenkins-hbase4:46557] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=373.39 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/a85b72f43920491eabc63d91a9037281 2023-07-18 10:13:13,079 INFO [M:0;jenkins-hbase4:46557] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a85b72f43920491eabc63d91a9037281 2023-07-18 10:13:13,080 DEBUG [M:0;jenkins-hbase4:46557] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/a85b72f43920491eabc63d91a9037281 as hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/a85b72f43920491eabc63d91a9037281 2023-07-18 10:13:13,085 INFO [M:0;jenkins-hbase4:46557] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a85b72f43920491eabc63d91a9037281 2023-07-18 10:13:13,085 INFO [M:0;jenkins-hbase4:46557] regionserver.HStore(1080): Added hdfs://localhost:35953/user/jenkins/test-data/018994dc-cbb0-77a3-f349-5de465614336/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/a85b72f43920491eabc63d91a9037281, entries=119, sequenceid=899, filesize=28.5 K 2023-07-18 10:13:13,086 INFO [M:0;jenkins-hbase4:46557] regionserver.HRegion(2948): Finished flush of dataSize ~373.39 KB/382348, heapSize ~449.61 KB/460400, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 31ms, sequenceid=899, compaction requested=false 2023-07-18 10:13:13,087 INFO [M:0;jenkins-hbase4:46557] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 10:13:13,088 DEBUG [M:0;jenkins-hbase4:46557] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-18 10:13:13,091 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-18 10:13:13,091 INFO [M:0;jenkins-hbase4:46557] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-18 10:13:13,092 INFO [M:0;jenkins-hbase4:46557] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46557 2023-07-18 10:13:13,093 DEBUG [M:0;jenkins-hbase4:46557] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,46557,1689675026042 already deleted, retry=false 2023-07-18 10:13:13,134 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 10:13:13,134 INFO [RS:1;jenkins-hbase4:34221] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,34221,1689675027589; zookeeper connection closed. 2023-07-18 10:13:13,134 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34221-0x10177e94dcb0002, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 10:13:13,135 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1483029f] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1483029f 2023-07-18 10:13:13,234 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 10:13:13,234 INFO [M:0;jenkins-hbase4:46557] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,46557,1689675026042; zookeeper connection closed. 2023-07-18 10:13:13,235 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:46557-0x10177e94dcb0000, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 10:13:13,335 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 10:13:13,335 INFO [RS:0;jenkins-hbase4:40089] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,40089,1689675027524; zookeeper connection closed. 2023-07-18 10:13:13,335 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40089-0x10177e94dcb0001, quorum=127.0.0.1:56089, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 10:13:13,335 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7cb4606e] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7cb4606e 2023-07-18 10:13:13,335 INFO [Listener at jenkins-hbase4.apache.org/42677] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-18 10:13:13,336 WARN [Listener at jenkins-hbase4.apache.org/42677] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-18 10:13:13,339 INFO [Listener at jenkins-hbase4.apache.org/42677] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-18 10:13:13,443 WARN [BP-1910105515-172.31.14.131-1689675022015 heartbeating to localhost/127.0.0.1:35953] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-18 10:13:13,444 WARN [BP-1910105515-172.31.14.131-1689675022015 heartbeating to localhost/127.0.0.1:35953] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1910105515-172.31.14.131-1689675022015 (Datanode Uuid 89726bd3-6646-480a-9362-ca327c33d43e) service to localhost/127.0.0.1:35953 2023-07-18 10:13:13,446 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/cluster_c337c4fc-2ada-e3f9-7d55-d4eaef1ef56e/dfs/data/data5/current/BP-1910105515-172.31.14.131-1689675022015] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-18 10:13:13,447 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/cluster_c337c4fc-2ada-e3f9-7d55-d4eaef1ef56e/dfs/data/data6/current/BP-1910105515-172.31.14.131-1689675022015] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-18 10:13:13,448 WARN [Listener at jenkins-hbase4.apache.org/42677] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-18 10:13:13,457 INFO [Listener at jenkins-hbase4.apache.org/42677] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-18 10:13:13,463 WARN [BP-1910105515-172.31.14.131-1689675022015 heartbeating to localhost/127.0.0.1:35953] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-18 10:13:13,463 WARN [BP-1910105515-172.31.14.131-1689675022015 heartbeating to localhost/127.0.0.1:35953] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1910105515-172.31.14.131-1689675022015 (Datanode Uuid a7961726-788a-4c7f-9006-c9268c78154c) service to localhost/127.0.0.1:35953 2023-07-18 10:13:13,464 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/cluster_c337c4fc-2ada-e3f9-7d55-d4eaef1ef56e/dfs/data/data3/current/BP-1910105515-172.31.14.131-1689675022015] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-18 10:13:13,464 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/cluster_c337c4fc-2ada-e3f9-7d55-d4eaef1ef56e/dfs/data/data4/current/BP-1910105515-172.31.14.131-1689675022015] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-18 10:13:13,465 WARN [Listener at jenkins-hbase4.apache.org/42677] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-18 10:13:13,468 INFO [Listener at jenkins-hbase4.apache.org/42677] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-18 10:13:13,470 WARN [BP-1910105515-172.31.14.131-1689675022015 heartbeating to localhost/127.0.0.1:35953] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-18 10:13:13,470 WARN [BP-1910105515-172.31.14.131-1689675022015 heartbeating to localhost/127.0.0.1:35953] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1910105515-172.31.14.131-1689675022015 (Datanode Uuid 53edb0d3-2f85-456e-b7c5-1922100b04ad) service to localhost/127.0.0.1:35953 2023-07-18 10:13:13,471 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/cluster_c337c4fc-2ada-e3f9-7d55-d4eaef1ef56e/dfs/data/data1/current/BP-1910105515-172.31.14.131-1689675022015] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-18 10:13:13,472 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/06f5742d-af23-59d0-1dc7-bff58363dedd/cluster_c337c4fc-2ada-e3f9-7d55-d4eaef1ef56e/dfs/data/data2/current/BP-1910105515-172.31.14.131-1689675022015] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-18 10:13:13,497 INFO [Listener at jenkins-hbase4.apache.org/42677] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-18 10:13:13,623 INFO [Listener at jenkins-hbase4.apache.org/42677] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-18 10:13:13,713 INFO [Listener at jenkins-hbase4.apache.org/42677] hbase.HBaseTestingUtility(1293): Minicluster is down