2023-07-19 18:10:12,071 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-19 18:10:12,339 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4 2023-07-19 18:10:12,339 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestSecureExportSnapshot timeout: 13 mins 2023-07-19 18:10:12,376 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-19 18:10:12,653 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-19 18:10:12,654 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/cluster_043905fa-2e83-af1f-d7d3-c2f0c5ac65c2, deleteOnExit=true 2023-07-19 18:10:12,654 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-19 18:10:12,655 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/test.cache.data in system properties and HBase conf 2023-07-19 18:10:12,656 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/hadoop.tmp.dir in system properties and HBase conf 2023-07-19 18:10:12,656 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/hadoop.log.dir in system properties and HBase conf 2023-07-19 18:10:12,657 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-19 18:10:12,657 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-19 18:10:12,657 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-19 18:10:12,987 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-19 18:10:12,991 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-19 18:10:12,992 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-19 18:10:12,992 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-19 18:10:12,992 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-19 18:10:12,992 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-19 18:10:12,993 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-19 18:10:12,993 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-19 18:10:12,994 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-19 18:10:12,994 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-19 18:10:12,995 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/nfs.dump.dir in system properties and HBase conf 2023-07-19 18:10:12,995 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/java.io.tmpdir in system properties and HBase conf 2023-07-19 18:10:12,995 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-19 18:10:12,996 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-19 18:10:12,996 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-19 18:10:13,668 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-19 18:10:13,672 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-19 18:10:13,965 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-19 18:10:14,140 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-19 18:10:14,161 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 18:10:14,196 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 18:10:14,230 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/java.io.tmpdir/Jetty_localhost_45125_hdfs____bm122l/webapp 2023-07-19 18:10:14,383 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45125 2023-07-19 18:10:14,424 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-19 18:10:14,424 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-19 18:10:14,943 WARN [Listener at localhost/40881] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-19 18:10:15,032 WARN [Listener at localhost/40881] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-19 18:10:15,059 WARN [Listener at localhost/40881] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 18:10:15,066 INFO [Listener at localhost/40881] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 18:10:15,074 INFO [Listener at localhost/40881] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/java.io.tmpdir/Jetty_localhost_43249_datanode____vl8a4f/webapp 2023-07-19 18:10:15,190 INFO [Listener at localhost/40881] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43249 2023-07-19 18:10:15,854 WARN [Listener at localhost/37099] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-19 18:10:15,911 WARN [Listener at localhost/37099] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-19 18:10:15,917 WARN [Listener at localhost/37099] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 18:10:15,921 INFO [Listener at localhost/37099] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 18:10:15,928 INFO [Listener at localhost/37099] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/java.io.tmpdir/Jetty_localhost_43697_datanode____s6qel8/webapp 2023-07-19 18:10:16,077 INFO [Listener at localhost/37099] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43697 2023-07-19 18:10:16,102 WARN [Listener at localhost/45773] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-19 18:10:16,212 WARN [Listener at localhost/45773] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-19 18:10:16,217 WARN [Listener at localhost/45773] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 18:10:16,220 INFO [Listener at localhost/45773] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 18:10:16,228 INFO [Listener at localhost/45773] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/java.io.tmpdir/Jetty_localhost_33685_datanode____nvdg3e/webapp 2023-07-19 18:10:16,369 INFO [Listener at localhost/45773] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33685 2023-07-19 18:10:16,434 WARN [Listener at localhost/41305] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-19 18:10:16,634 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1d28e1290e9271c3: Processing first storage report for DS-a911110b-c733-494e-b19b-5b9cd476cd41 from datanode 66a31133-ac7f-4072-9f43-6a048acb97a2 2023-07-19 18:10:16,636 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1d28e1290e9271c3: from storage DS-a911110b-c733-494e-b19b-5b9cd476cd41 node DatanodeRegistration(127.0.0.1:34269, datanodeUuid=66a31133-ac7f-4072-9f43-6a048acb97a2, infoPort=43653, infoSecurePort=0, ipcPort=45773, storageInfo=lv=-57;cid=testClusterID;nsid=1784018228;c=1689790213745), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-19 18:10:16,636 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5f5e4835f576290c: Processing first storage report for DS-2148f4fa-3c80-4f0a-9d47-0b5b3bda69ec from datanode 711cbe76-14c4-4bfc-84f2-1aa9e4e19de4 2023-07-19 18:10:16,636 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5f5e4835f576290c: from storage DS-2148f4fa-3c80-4f0a-9d47-0b5b3bda69ec node DatanodeRegistration(127.0.0.1:37793, datanodeUuid=711cbe76-14c4-4bfc-84f2-1aa9e4e19de4, infoPort=38227, infoSecurePort=0, ipcPort=37099, storageInfo=lv=-57;cid=testClusterID;nsid=1784018228;c=1689790213745), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-19 18:10:16,636 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5f5e4835f576290c: Processing first storage report for DS-4504b310-3d50-4c3a-85e5-5c8d9e1c10d6 from datanode 711cbe76-14c4-4bfc-84f2-1aa9e4e19de4 2023-07-19 18:10:16,637 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5f5e4835f576290c: from storage DS-4504b310-3d50-4c3a-85e5-5c8d9e1c10d6 node DatanodeRegistration(127.0.0.1:37793, datanodeUuid=711cbe76-14c4-4bfc-84f2-1aa9e4e19de4, infoPort=38227, infoSecurePort=0, ipcPort=37099, storageInfo=lv=-57;cid=testClusterID;nsid=1784018228;c=1689790213745), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-19 18:10:16,637 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1d28e1290e9271c3: Processing first storage report for DS-6da77519-b18c-421e-9a8b-85902f8784a7 from datanode 66a31133-ac7f-4072-9f43-6a048acb97a2 2023-07-19 18:10:16,637 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1d28e1290e9271c3: from storage DS-6da77519-b18c-421e-9a8b-85902f8784a7 node DatanodeRegistration(127.0.0.1:34269, datanodeUuid=66a31133-ac7f-4072-9f43-6a048acb97a2, infoPort=43653, infoSecurePort=0, ipcPort=45773, storageInfo=lv=-57;cid=testClusterID;nsid=1784018228;c=1689790213745), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-19 18:10:16,657 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3fec464051557b1b: Processing first storage report for DS-ae840c29-7966-40fe-84f0-5f57bcdc1c48 from datanode e53dee0c-96c9-432f-938c-bdcff9b15cdf 2023-07-19 18:10:16,657 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3fec464051557b1b: from storage DS-ae840c29-7966-40fe-84f0-5f57bcdc1c48 node DatanodeRegistration(127.0.0.1:43551, datanodeUuid=e53dee0c-96c9-432f-938c-bdcff9b15cdf, infoPort=40755, infoSecurePort=0, ipcPort=41305, storageInfo=lv=-57;cid=testClusterID;nsid=1784018228;c=1689790213745), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-19 18:10:16,657 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3fec464051557b1b: Processing first storage report for DS-a8e3e9a4-69a5-4e31-b09e-0ffa6db02f85 from datanode e53dee0c-96c9-432f-938c-bdcff9b15cdf 2023-07-19 18:10:16,657 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3fec464051557b1b: from storage DS-a8e3e9a4-69a5-4e31-b09e-0ffa6db02f85 node DatanodeRegistration(127.0.0.1:43551, datanodeUuid=e53dee0c-96c9-432f-938c-bdcff9b15cdf, infoPort=40755, infoSecurePort=0, ipcPort=41305, storageInfo=lv=-57;cid=testClusterID;nsid=1784018228;c=1689790213745), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-19 18:10:16,901 DEBUG [Listener at localhost/41305] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4 2023-07-19 18:10:16,994 INFO [Listener at localhost/41305] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/cluster_043905fa-2e83-af1f-d7d3-c2f0c5ac65c2/zookeeper_0, clientPort=51604, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/cluster_043905fa-2e83-af1f-d7d3-c2f0c5ac65c2/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/cluster_043905fa-2e83-af1f-d7d3-c2f0c5ac65c2/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-19 18:10:17,020 INFO [Listener at localhost/41305] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=51604 2023-07-19 18:10:17,033 INFO [Listener at localhost/41305] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 18:10:17,035 INFO [Listener at localhost/41305] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 18:10:17,735 INFO [Listener at localhost/41305] util.FSUtils(471): Created version file at hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf with version=8 2023-07-19 18:10:17,735 INFO [Listener at localhost/41305] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/hbase-staging 2023-07-19 18:10:18,146 INFO [Listener at localhost/41305] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-19 18:10:18,796 INFO [Listener at localhost/41305] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-19 18:10:18,839 INFO [Listener at localhost/41305] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 18:10:18,839 INFO [Listener at localhost/41305] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-19 18:10:18,839 INFO [Listener at localhost/41305] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-19 18:10:18,840 INFO [Listener at localhost/41305] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 18:10:18,840 INFO [Listener at localhost/41305] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-19 18:10:19,019 INFO [Listener at localhost/41305] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-19 18:10:19,105 DEBUG [Listener at localhost/41305] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-19 18:10:19,230 INFO [Listener at localhost/41305] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40453 2023-07-19 18:10:19,247 INFO [Listener at localhost/41305] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 18:10:19,250 INFO [Listener at localhost/41305] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 18:10:19,276 INFO [Listener at localhost/41305] zookeeper.RecoverableZooKeeper(93): Process identifier=master:40453 connecting to ZooKeeper ensemble=127.0.0.1:51604 2023-07-19 18:10:19,333 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:404530x0, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-19 18:10:19,338 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:40453-0x1017ec6fe090000 connected 2023-07-19 18:10:19,387 DEBUG [Listener at localhost/41305] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-19 18:10:19,388 DEBUG [Listener at localhost/41305] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 18:10:19,405 DEBUG [Listener at localhost/41305] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-19 18:10:19,415 DEBUG [Listener at localhost/41305] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40453 2023-07-19 18:10:19,418 DEBUG [Listener at localhost/41305] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40453 2023-07-19 18:10:19,419 DEBUG [Listener at localhost/41305] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40453 2023-07-19 18:10:19,424 DEBUG [Listener at localhost/41305] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40453 2023-07-19 18:10:19,426 DEBUG [Listener at localhost/41305] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40453 2023-07-19 18:10:19,440 INFO [Listener at localhost/41305] master.HMaster(444): hbase.rootdir=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf, hbase.cluster.distributed=false 2023-07-19 18:10:19,525 INFO [Listener at localhost/41305] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-19 18:10:19,526 INFO [Listener at localhost/41305] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 18:10:19,526 INFO [Listener at localhost/41305] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-19 18:10:19,526 INFO [Listener at localhost/41305] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-19 18:10:19,526 INFO [Listener at localhost/41305] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 18:10:19,526 INFO [Listener at localhost/41305] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-19 18:10:19,532 INFO [Listener at localhost/41305] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-19 18:10:19,539 INFO [Listener at localhost/41305] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40317 2023-07-19 18:10:19,543 INFO [Listener at localhost/41305] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-19 18:10:19,561 DEBUG [Listener at localhost/41305] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-19 18:10:19,562 INFO [Listener at localhost/41305] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 18:10:19,565 INFO [Listener at localhost/41305] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 18:10:19,568 INFO [Listener at localhost/41305] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40317 connecting to ZooKeeper ensemble=127.0.0.1:51604 2023-07-19 18:10:19,574 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:403170x0, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-19 18:10:19,575 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:40317-0x1017ec6fe090001 connected 2023-07-19 18:10:19,576 DEBUG [Listener at localhost/41305] zookeeper.ZKUtil(164): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-19 18:10:19,577 DEBUG [Listener at localhost/41305] zookeeper.ZKUtil(164): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 18:10:19,578 DEBUG [Listener at localhost/41305] zookeeper.ZKUtil(164): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-19 18:10:19,585 DEBUG [Listener at localhost/41305] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40317 2023-07-19 18:10:19,585 DEBUG [Listener at localhost/41305] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40317 2023-07-19 18:10:19,586 DEBUG [Listener at localhost/41305] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40317 2023-07-19 18:10:19,591 DEBUG [Listener at localhost/41305] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40317 2023-07-19 18:10:19,591 DEBUG [Listener at localhost/41305] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40317 2023-07-19 18:10:19,605 INFO [Listener at localhost/41305] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-19 18:10:19,605 INFO [Listener at localhost/41305] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 18:10:19,606 INFO [Listener at localhost/41305] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-19 18:10:19,606 INFO [Listener at localhost/41305] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-19 18:10:19,607 INFO [Listener at localhost/41305] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 18:10:19,607 INFO [Listener at localhost/41305] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-19 18:10:19,607 INFO [Listener at localhost/41305] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-19 18:10:19,609 INFO [Listener at localhost/41305] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33037 2023-07-19 18:10:19,610 INFO [Listener at localhost/41305] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-19 18:10:19,614 DEBUG [Listener at localhost/41305] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-19 18:10:19,615 INFO [Listener at localhost/41305] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 18:10:19,618 INFO [Listener at localhost/41305] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 18:10:19,620 INFO [Listener at localhost/41305] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33037 connecting to ZooKeeper ensemble=127.0.0.1:51604 2023-07-19 18:10:19,628 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:330370x0, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-19 18:10:19,630 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:33037-0x1017ec6fe090002 connected 2023-07-19 18:10:19,630 DEBUG [Listener at localhost/41305] zookeeper.ZKUtil(164): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-19 18:10:19,632 DEBUG [Listener at localhost/41305] zookeeper.ZKUtil(164): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 18:10:19,633 DEBUG [Listener at localhost/41305] zookeeper.ZKUtil(164): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-19 18:10:19,639 DEBUG [Listener at localhost/41305] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33037 2023-07-19 18:10:19,640 DEBUG [Listener at localhost/41305] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33037 2023-07-19 18:10:19,646 DEBUG [Listener at localhost/41305] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33037 2023-07-19 18:10:19,653 DEBUG [Listener at localhost/41305] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33037 2023-07-19 18:10:19,653 DEBUG [Listener at localhost/41305] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33037 2023-07-19 18:10:19,669 INFO [Listener at localhost/41305] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-19 18:10:19,669 INFO [Listener at localhost/41305] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 18:10:19,670 INFO [Listener at localhost/41305] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-19 18:10:19,670 INFO [Listener at localhost/41305] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-19 18:10:19,670 INFO [Listener at localhost/41305] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 18:10:19,670 INFO [Listener at localhost/41305] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-19 18:10:19,670 INFO [Listener at localhost/41305] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-19 18:10:19,684 INFO [Listener at localhost/41305] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44407 2023-07-19 18:10:19,685 INFO [Listener at localhost/41305] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-19 18:10:19,687 DEBUG [Listener at localhost/41305] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-19 18:10:19,688 INFO [Listener at localhost/41305] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 18:10:19,691 INFO [Listener at localhost/41305] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 18:10:19,692 INFO [Listener at localhost/41305] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44407 connecting to ZooKeeper ensemble=127.0.0.1:51604 2023-07-19 18:10:19,697 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:444070x0, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-19 18:10:19,698 DEBUG [Listener at localhost/41305] zookeeper.ZKUtil(164): regionserver:444070x0, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-19 18:10:19,699 DEBUG [Listener at localhost/41305] zookeeper.ZKUtil(164): regionserver:444070x0, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 18:10:19,700 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:44407-0x1017ec6fe090003 connected 2023-07-19 18:10:19,700 DEBUG [Listener at localhost/41305] zookeeper.ZKUtil(164): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-19 18:10:19,706 DEBUG [Listener at localhost/41305] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44407 2023-07-19 18:10:19,707 DEBUG [Listener at localhost/41305] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44407 2023-07-19 18:10:19,707 DEBUG [Listener at localhost/41305] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44407 2023-07-19 18:10:19,712 DEBUG [Listener at localhost/41305] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44407 2023-07-19 18:10:19,713 DEBUG [Listener at localhost/41305] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44407 2023-07-19 18:10:19,719 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,40453,1689790217932 2023-07-19 18:10:19,729 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-19 18:10:19,731 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,40453,1689790217932 2023-07-19 18:10:19,753 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-19 18:10:19,753 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-19 18:10:19,753 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-19 18:10:19,753 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-19 18:10:19,754 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 18:10:19,755 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-19 18:10:19,757 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,40453,1689790217932 from backup master directory 2023-07-19 18:10:19,758 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-19 18:10:19,763 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,40453,1689790217932 2023-07-19 18:10:19,763 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-19 18:10:19,764 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-19 18:10:19,765 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,40453,1689790217932 2023-07-19 18:10:19,768 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-19 18:10:19,769 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-19 18:10:19,884 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/hbase.id with ID: d3af2609-7287-43f0-a86b-06729f422ad1 2023-07-19 18:10:19,945 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 18:10:19,972 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 18:10:20,051 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x1ac5cc0b to 127.0.0.1:51604 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 18:10:20,103 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2a0963c9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 18:10:20,136 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-19 18:10:20,138 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-19 18:10:20,161 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-19 18:10:20,162 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-19 18:10:20,165 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-19 18:10:20,171 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-19 18:10:20,173 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-19 18:10:20,218 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/MasterData/data/master/store-tmp 2023-07-19 18:10:20,291 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 18:10:20,291 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-19 18:10:20,291 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 18:10:20,291 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 18:10:20,291 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-19 18:10:20,292 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 18:10:20,292 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 18:10:20,292 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-19 18:10:20,294 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/MasterData/WALs/jenkins-hbase4.apache.org,40453,1689790217932 2023-07-19 18:10:20,324 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40453%2C1689790217932, suffix=, logDir=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/MasterData/WALs/jenkins-hbase4.apache.org,40453,1689790217932, archiveDir=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/MasterData/oldWALs, maxLogs=10 2023-07-19 18:10:20,413 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37793,DS-2148f4fa-3c80-4f0a-9d47-0b5b3bda69ec,DISK] 2023-07-19 18:10:20,413 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34269,DS-a911110b-c733-494e-b19b-5b9cd476cd41,DISK] 2023-07-19 18:10:20,413 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43551,DS-ae840c29-7966-40fe-84f0-5f57bcdc1c48,DISK] 2023-07-19 18:10:20,430 DEBUG [RS-EventLoopGroup-5-1] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-19 18:10:20,523 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/MasterData/WALs/jenkins-hbase4.apache.org,40453,1689790217932/jenkins-hbase4.apache.org%2C40453%2C1689790217932.1689790220339 2023-07-19 18:10:20,524 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37793,DS-2148f4fa-3c80-4f0a-9d47-0b5b3bda69ec,DISK], DatanodeInfoWithStorage[127.0.0.1:34269,DS-a911110b-c733-494e-b19b-5b9cd476cd41,DISK], DatanodeInfoWithStorage[127.0.0.1:43551,DS-ae840c29-7966-40fe-84f0-5f57bcdc1c48,DISK]] 2023-07-19 18:10:20,525 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-19 18:10:20,525 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 18:10:20,529 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-19 18:10:20,531 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-19 18:10:20,634 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-19 18:10:20,642 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-19 18:10:20,675 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-19 18:10:20,690 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 18:10:20,697 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-19 18:10:20,699 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-19 18:10:20,715 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-19 18:10:20,719 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 18:10:20,720 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74709706, jitterRate=0.11326137185096741}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 18:10:20,720 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-19 18:10:20,722 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-19 18:10:20,755 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-19 18:10:20,755 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-19 18:10:20,759 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-19 18:10:20,761 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-19 18:10:20,802 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 40 msec 2023-07-19 18:10:20,802 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-19 18:10:20,841 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-19 18:10:20,848 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-19 18:10:20,886 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-19 18:10:20,893 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-19 18:10:20,895 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-19 18:10:20,904 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-19 18:10:20,911 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-19 18:10:20,917 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 18:10:20,920 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-19 18:10:20,921 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-19 18:10:20,941 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-19 18:10:20,948 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-19 18:10:20,948 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-19 18:10:20,948 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-19 18:10:20,948 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 18:10:20,948 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-19 18:10:20,952 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,40453,1689790217932, sessionid=0x1017ec6fe090000, setting cluster-up flag (Was=false) 2023-07-19 18:10:20,974 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 18:10:20,991 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-19 18:10:20,994 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40453,1689790217932 2023-07-19 18:10:21,005 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 18:10:21,018 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-19 18:10:21,021 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40453,1689790217932 2023-07-19 18:10:21,025 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/.tmp 2023-07-19 18:10:21,140 INFO [RS:0;jenkins-hbase4:40317] regionserver.HRegionServer(951): ClusterId : d3af2609-7287-43f0-a86b-06729f422ad1 2023-07-19 18:10:21,142 INFO [RS:2;jenkins-hbase4:44407] regionserver.HRegionServer(951): ClusterId : d3af2609-7287-43f0-a86b-06729f422ad1 2023-07-19 18:10:21,140 INFO [RS:1;jenkins-hbase4:33037] regionserver.HRegionServer(951): ClusterId : d3af2609-7287-43f0-a86b-06729f422ad1 2023-07-19 18:10:21,163 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-19 18:10:21,166 DEBUG [RS:0;jenkins-hbase4:40317] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-19 18:10:21,166 DEBUG [RS:1;jenkins-hbase4:33037] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-19 18:10:21,166 DEBUG [RS:2;jenkins-hbase4:44407] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-19 18:10:21,175 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 18:10:21,177 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-19 18:10:21,181 DEBUG [RS:0;jenkins-hbase4:40317] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-19 18:10:21,181 DEBUG [RS:0;jenkins-hbase4:40317] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-19 18:10:21,182 DEBUG [RS:2;jenkins-hbase4:44407] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-19 18:10:21,182 DEBUG [RS:2;jenkins-hbase4:44407] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-19 18:10:21,185 DEBUG [RS:1;jenkins-hbase4:33037] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-19 18:10:21,186 DEBUG [RS:1;jenkins-hbase4:33037] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-19 18:10:21,187 DEBUG [RS:0;jenkins-hbase4:40317] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-19 18:10:21,188 DEBUG [RS:0;jenkins-hbase4:40317] zookeeper.ReadOnlyZKClient(139): Connect 0x4f36be74 to 127.0.0.1:51604 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 18:10:21,194 DEBUG [RS:1;jenkins-hbase4:33037] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-19 18:10:21,199 DEBUG [RS:1;jenkins-hbase4:33037] zookeeper.ReadOnlyZKClient(139): Connect 0x2138077e to 127.0.0.1:51604 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 18:10:21,208 DEBUG [RS:2;jenkins-hbase4:44407] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-19 18:10:21,211 DEBUG [RS:2;jenkins-hbase4:44407] zookeeper.ReadOnlyZKClient(139): Connect 0x43458041 to 127.0.0.1:51604 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 18:10:21,232 DEBUG [RS:0;jenkins-hbase4:40317] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@59a64b74, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 18:10:21,232 DEBUG [RS:0;jenkins-hbase4:40317] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@52a25265, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-19 18:10:21,242 DEBUG [RS:1;jenkins-hbase4:33037] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2fffed29, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 18:10:21,243 DEBUG [RS:1;jenkins-hbase4:33037] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2bc06c0e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-19 18:10:21,244 DEBUG [RS:2;jenkins-hbase4:44407] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d827659, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 18:10:21,244 DEBUG [RS:2;jenkins-hbase4:44407] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@cbf7c62, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-19 18:10:21,262 DEBUG [RS:0;jenkins-hbase4:40317] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:40317 2023-07-19 18:10:21,263 DEBUG [RS:2;jenkins-hbase4:44407] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:44407 2023-07-19 18:10:21,270 INFO [RS:0;jenkins-hbase4:40317] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-19 18:10:21,270 INFO [RS:0;jenkins-hbase4:40317] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-19 18:10:21,271 DEBUG [RS:0;jenkins-hbase4:40317] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-19 18:10:21,273 DEBUG [RS:1;jenkins-hbase4:33037] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:33037 2023-07-19 18:10:21,273 INFO [RS:1;jenkins-hbase4:33037] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-19 18:10:21,274 INFO [RS:1;jenkins-hbase4:33037] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-19 18:10:21,274 DEBUG [RS:1;jenkins-hbase4:33037] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-19 18:10:21,273 INFO [RS:2;jenkins-hbase4:44407] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-19 18:10:21,275 INFO [RS:2;jenkins-hbase4:44407] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-19 18:10:21,275 DEBUG [RS:2;jenkins-hbase4:44407] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-19 18:10:21,275 INFO [RS:2;jenkins-hbase4:44407] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 18:10:21,281 DEBUG [RS:2;jenkins-hbase4:44407] regionserver.HRegionServer(1022): About to register with Master. 2023-07-19 18:10:21,274 INFO [RS:1;jenkins-hbase4:33037] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 18:10:21,282 DEBUG [RS:1;jenkins-hbase4:33037] regionserver.HRegionServer(1022): About to register with Master. 2023-07-19 18:10:21,284 INFO [RS:0;jenkins-hbase4:40317] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 18:10:21,284 DEBUG [RS:0;jenkins-hbase4:40317] regionserver.HRegionServer(1022): About to register with Master. 2023-07-19 18:10:21,286 INFO [RS:1;jenkins-hbase4:33037] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40453,1689790217932 with isa=jenkins-hbase4.apache.org/172.31.14.131:33037, startcode=1689790219604 2023-07-19 18:10:21,287 INFO [RS:2;jenkins-hbase4:44407] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40453,1689790217932 with isa=jenkins-hbase4.apache.org/172.31.14.131:44407, startcode=1689790219668 2023-07-19 18:10:21,288 INFO [RS:0;jenkins-hbase4:40317] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40453,1689790217932 with isa=jenkins-hbase4.apache.org/172.31.14.131:40317, startcode=1689790219525 2023-07-19 18:10:21,310 DEBUG [RS:2;jenkins-hbase4:44407] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-19 18:10:21,319 DEBUG [RS:1;jenkins-hbase4:33037] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-19 18:10:21,310 DEBUG [RS:0;jenkins-hbase4:40317] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-19 18:10:21,324 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-19 18:10:21,338 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-19 18:10:21,338 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-19 18:10:21,338 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-19 18:10:21,338 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-19 18:10:21,338 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-19 18:10:21,338 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 18:10:21,338 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-19 18:10:21,338 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 18:10:21,358 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689790251358 2023-07-19 18:10:21,379 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-19 18:10:21,386 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-19 18:10:21,386 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-19 18:10:21,394 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-19 18:10:21,402 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-19 18:10:21,412 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-19 18:10:21,415 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-19 18:10:21,416 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-19 18:10:21,416 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-19 18:10:21,419 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-19 18:10:21,436 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46981, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-19 18:10:21,437 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-19 18:10:21,437 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43031, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-19 18:10:21,437 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47663, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-19 18:10:21,445 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-19 18:10:21,446 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-19 18:10:21,449 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40453] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-19 18:10:21,460 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40453] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-19 18:10:21,461 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40453] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-19 18:10:21,464 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-19 18:10:21,464 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-19 18:10:21,469 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689790221466,5,FailOnTimeoutGroup] 2023-07-19 18:10:21,470 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689790221470,5,FailOnTimeoutGroup] 2023-07-19 18:10:21,471 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-19 18:10:21,471 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-19 18:10:21,473 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-19 18:10:21,473 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-19 18:10:21,496 DEBUG [RS:2;jenkins-hbase4:44407] regionserver.HRegionServer(2830): Master is not running yet 2023-07-19 18:10:21,496 DEBUG [RS:1;jenkins-hbase4:33037] regionserver.HRegionServer(2830): Master is not running yet 2023-07-19 18:10:21,496 WARN [RS:1;jenkins-hbase4:33037] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-19 18:10:21,496 DEBUG [RS:0;jenkins-hbase4:40317] regionserver.HRegionServer(2830): Master is not running yet 2023-07-19 18:10:21,496 WARN [RS:2;jenkins-hbase4:44407] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-19 18:10:21,497 WARN [RS:0;jenkins-hbase4:40317] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-19 18:10:21,529 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-19 18:10:21,530 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-19 18:10:21,531 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf 2023-07-19 18:10:21,586 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 18:10:21,589 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-19 18:10:21,592 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/hbase/meta/1588230740/info 2023-07-19 18:10:21,593 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-19 18:10:21,594 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 18:10:21,594 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-19 18:10:21,598 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/hbase/meta/1588230740/rep_barrier 2023-07-19 18:10:21,598 INFO [RS:0;jenkins-hbase4:40317] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40453,1689790217932 with isa=jenkins-hbase4.apache.org/172.31.14.131:40317, startcode=1689790219525 2023-07-19 18:10:21,598 INFO [RS:1;jenkins-hbase4:33037] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40453,1689790217932 with isa=jenkins-hbase4.apache.org/172.31.14.131:33037, startcode=1689790219604 2023-07-19 18:10:21,599 INFO [RS:2;jenkins-hbase4:44407] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40453,1689790217932 with isa=jenkins-hbase4.apache.org/172.31.14.131:44407, startcode=1689790219668 2023-07-19 18:10:21,599 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-19 18:10:21,604 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 18:10:21,604 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-19 18:10:21,605 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40453] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:21,609 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/hbase/meta/1588230740/table 2023-07-19 18:10:21,610 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-19 18:10:21,611 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 18:10:21,613 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40453] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:21,614 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/hbase/meta/1588230740 2023-07-19 18:10:21,614 DEBUG [RS:0;jenkins-hbase4:40317] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf 2023-07-19 18:10:21,614 DEBUG [RS:0;jenkins-hbase4:40317] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:40881 2023-07-19 18:10:21,614 DEBUG [RS:0;jenkins-hbase4:40317] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-19 18:10:21,614 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40453] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:21,615 DEBUG [RS:2;jenkins-hbase4:44407] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf 2023-07-19 18:10:21,615 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/hbase/meta/1588230740 2023-07-19 18:10:21,615 DEBUG [RS:2;jenkins-hbase4:44407] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:40881 2023-07-19 18:10:21,616 DEBUG [RS:1;jenkins-hbase4:33037] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf 2023-07-19 18:10:21,617 DEBUG [RS:2;jenkins-hbase4:44407] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-19 18:10:21,617 DEBUG [RS:1;jenkins-hbase4:33037] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:40881 2023-07-19 18:10:21,617 DEBUG [RS:1;jenkins-hbase4:33037] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-19 18:10:21,623 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-19 18:10:21,625 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 18:10:21,632 DEBUG [RS:2;jenkins-hbase4:44407] zookeeper.ZKUtil(162): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:21,632 WARN [RS:2;jenkins-hbase4:44407] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-19 18:10:21,632 INFO [RS:2;jenkins-hbase4:44407] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-19 18:10:21,632 DEBUG [RS:2;jenkins-hbase4:44407] regionserver.HRegionServer(1948): logDir=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/WALs/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:21,633 DEBUG [RS:0;jenkins-hbase4:40317] zookeeper.ZKUtil(162): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:21,633 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,44407,1689790219668] 2023-07-19 18:10:21,634 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40317,1689790219525] 2023-07-19 18:10:21,634 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,33037,1689790219604] 2023-07-19 18:10:21,635 DEBUG [RS:1;jenkins-hbase4:33037] zookeeper.ZKUtil(162): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:21,633 WARN [RS:0;jenkins-hbase4:40317] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-19 18:10:21,635 WARN [RS:1;jenkins-hbase4:33037] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-19 18:10:21,636 INFO [RS:1;jenkins-hbase4:33037] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-19 18:10:21,638 DEBUG [RS:1;jenkins-hbase4:33037] regionserver.HRegionServer(1948): logDir=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/WALs/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:21,636 INFO [RS:0;jenkins-hbase4:40317] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-19 18:10:21,637 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-19 18:10:21,639 DEBUG [RS:0;jenkins-hbase4:40317] regionserver.HRegionServer(1948): logDir=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/WALs/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:21,677 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 18:10:21,694 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74246742, jitterRate=0.10636267066001892}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-19 18:10:21,694 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-19 18:10:21,695 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-19 18:10:21,695 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-19 18:10:21,695 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-19 18:10:21,695 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-19 18:10:21,695 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-19 18:10:21,698 DEBUG [RS:0;jenkins-hbase4:40317] zookeeper.ZKUtil(162): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:21,698 DEBUG [RS:1;jenkins-hbase4:33037] zookeeper.ZKUtil(162): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:21,699 DEBUG [RS:0;jenkins-hbase4:40317] zookeeper.ZKUtil(162): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:21,699 DEBUG [RS:1;jenkins-hbase4:33037] zookeeper.ZKUtil(162): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:21,699 DEBUG [RS:0;jenkins-hbase4:40317] zookeeper.ZKUtil(162): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:21,699 DEBUG [RS:1;jenkins-hbase4:33037] zookeeper.ZKUtil(162): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:21,700 DEBUG [RS:2;jenkins-hbase4:44407] zookeeper.ZKUtil(162): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:21,701 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-19 18:10:21,702 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-19 18:10:21,709 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-19 18:10:21,710 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-19 18:10:21,714 DEBUG [RS:2;jenkins-hbase4:44407] zookeeper.ZKUtil(162): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:21,715 DEBUG [RS:2;jenkins-hbase4:44407] zookeeper.ZKUtil(162): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:21,723 DEBUG [RS:2;jenkins-hbase4:44407] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-19 18:10:21,723 DEBUG [RS:1;jenkins-hbase4:33037] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-19 18:10:21,723 DEBUG [RS:0;jenkins-hbase4:40317] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-19 18:10:21,724 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-19 18:10:21,736 INFO [RS:1;jenkins-hbase4:33037] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-19 18:10:21,738 INFO [RS:2;jenkins-hbase4:44407] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-19 18:10:21,737 INFO [RS:0;jenkins-hbase4:40317] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-19 18:10:21,772 INFO [RS:2;jenkins-hbase4:44407] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-19 18:10:21,775 INFO [RS:1;jenkins-hbase4:33037] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-19 18:10:21,781 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-19 18:10:21,785 INFO [RS:1;jenkins-hbase4:33037] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-19 18:10:21,785 INFO [RS:1;jenkins-hbase4:33037] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 18:10:21,785 INFO [RS:2;jenkins-hbase4:44407] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-19 18:10:21,786 INFO [RS:2;jenkins-hbase4:44407] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 18:10:21,789 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-19 18:10:21,788 INFO [RS:1;jenkins-hbase4:33037] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-19 18:10:21,788 INFO [RS:0;jenkins-hbase4:40317] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-19 18:10:21,807 INFO [RS:0;jenkins-hbase4:40317] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-19 18:10:21,807 INFO [RS:0;jenkins-hbase4:40317] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 18:10:21,809 INFO [RS:2;jenkins-hbase4:44407] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-19 18:10:21,816 INFO [RS:0;jenkins-hbase4:40317] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-19 18:10:21,825 INFO [RS:1;jenkins-hbase4:33037] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-19 18:10:21,825 INFO [RS:0;jenkins-hbase4:40317] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-19 18:10:21,825 DEBUG [RS:1;jenkins-hbase4:33037] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 18:10:21,825 DEBUG [RS:1;jenkins-hbase4:33037] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 18:10:21,825 DEBUG [RS:0;jenkins-hbase4:40317] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 18:10:21,826 DEBUG [RS:1;jenkins-hbase4:33037] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 18:10:21,826 DEBUG [RS:0;jenkins-hbase4:40317] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 18:10:21,826 DEBUG [RS:1;jenkins-hbase4:33037] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 18:10:21,826 DEBUG [RS:0;jenkins-hbase4:40317] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 18:10:21,826 INFO [RS:2;jenkins-hbase4:44407] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-19 18:10:21,826 DEBUG [RS:0;jenkins-hbase4:40317] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 18:10:21,826 DEBUG [RS:2;jenkins-hbase4:44407] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 18:10:21,826 DEBUG [RS:1;jenkins-hbase4:33037] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 18:10:21,826 DEBUG [RS:2;jenkins-hbase4:44407] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 18:10:21,826 DEBUG [RS:1;jenkins-hbase4:33037] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-19 18:10:21,826 DEBUG [RS:2;jenkins-hbase4:44407] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 18:10:21,826 DEBUG [RS:1;jenkins-hbase4:33037] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 18:10:21,827 DEBUG [RS:1;jenkins-hbase4:33037] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 18:10:21,827 DEBUG [RS:1;jenkins-hbase4:33037] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 18:10:21,827 DEBUG [RS:1;jenkins-hbase4:33037] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 18:10:21,826 DEBUG [RS:0;jenkins-hbase4:40317] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 18:10:21,826 DEBUG [RS:2;jenkins-hbase4:44407] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 18:10:21,827 DEBUG [RS:0;jenkins-hbase4:40317] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-19 18:10:21,827 DEBUG [RS:2;jenkins-hbase4:44407] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 18:10:21,827 DEBUG [RS:0;jenkins-hbase4:40317] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 18:10:21,827 DEBUG [RS:2;jenkins-hbase4:44407] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-19 18:10:21,827 DEBUG [RS:0;jenkins-hbase4:40317] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 18:10:21,827 DEBUG [RS:2;jenkins-hbase4:44407] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 18:10:21,828 DEBUG [RS:0;jenkins-hbase4:40317] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 18:10:21,828 DEBUG [RS:2;jenkins-hbase4:44407] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 18:10:21,828 DEBUG [RS:0;jenkins-hbase4:40317] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 18:10:21,828 DEBUG [RS:2;jenkins-hbase4:44407] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 18:10:21,828 DEBUG [RS:2;jenkins-hbase4:44407] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 18:10:21,844 INFO [RS:2;jenkins-hbase4:44407] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 18:10:21,844 INFO [RS:2;jenkins-hbase4:44407] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 18:10:21,845 INFO [RS:2;jenkins-hbase4:44407] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-19 18:10:21,855 INFO [RS:1;jenkins-hbase4:33037] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 18:10:21,855 INFO [RS:1;jenkins-hbase4:33037] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 18:10:21,855 INFO [RS:1;jenkins-hbase4:33037] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-19 18:10:21,860 INFO [RS:0;jenkins-hbase4:40317] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 18:10:21,860 INFO [RS:0;jenkins-hbase4:40317] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 18:10:21,860 INFO [RS:0;jenkins-hbase4:40317] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-19 18:10:21,883 INFO [RS:1;jenkins-hbase4:33037] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-19 18:10:21,887 INFO [RS:1;jenkins-hbase4:33037] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33037,1689790219604-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 18:10:21,888 INFO [RS:2;jenkins-hbase4:44407] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-19 18:10:21,891 INFO [RS:2;jenkins-hbase4:44407] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44407,1689790219668-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 18:10:21,899 INFO [RS:0;jenkins-hbase4:40317] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-19 18:10:21,899 INFO [RS:0;jenkins-hbase4:40317] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40317,1689790219525-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 18:10:21,943 DEBUG [jenkins-hbase4:40453] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-19 18:10:21,951 DEBUG [jenkins-hbase4:40453] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 18:10:21,956 INFO [RS:0;jenkins-hbase4:40317] regionserver.Replication(203): jenkins-hbase4.apache.org,40317,1689790219525 started 2023-07-19 18:10:21,957 INFO [RS:0;jenkins-hbase4:40317] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,40317,1689790219525, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40317, sessionid=0x1017ec6fe090001 2023-07-19 18:10:21,958 INFO [RS:1;jenkins-hbase4:33037] regionserver.Replication(203): jenkins-hbase4.apache.org,33037,1689790219604 started 2023-07-19 18:10:21,958 DEBUG [RS:0;jenkins-hbase4:40317] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-19 18:10:21,958 INFO [RS:1;jenkins-hbase4:33037] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,33037,1689790219604, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:33037, sessionid=0x1017ec6fe090002 2023-07-19 18:10:21,958 DEBUG [RS:0;jenkins-hbase4:40317] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:21,958 DEBUG [RS:1;jenkins-hbase4:33037] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-19 18:10:21,958 DEBUG [RS:0;jenkins-hbase4:40317] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40317,1689790219525' 2023-07-19 18:10:21,958 DEBUG [RS:0;jenkins-hbase4:40317] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-19 18:10:21,958 DEBUG [RS:1;jenkins-hbase4:33037] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:21,959 DEBUG [RS:1;jenkins-hbase4:33037] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33037,1689790219604' 2023-07-19 18:10:21,960 DEBUG [RS:1;jenkins-hbase4:33037] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-19 18:10:21,960 DEBUG [RS:0;jenkins-hbase4:40317] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-19 18:10:21,961 DEBUG [jenkins-hbase4:40453] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 18:10:21,961 DEBUG [jenkins-hbase4:40453] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 18:10:21,961 DEBUG [RS:0;jenkins-hbase4:40317] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-19 18:10:21,961 DEBUG [RS:0;jenkins-hbase4:40317] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-19 18:10:21,961 DEBUG [RS:0;jenkins-hbase4:40317] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:21,961 DEBUG [RS:0;jenkins-hbase4:40317] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40317,1689790219525' 2023-07-19 18:10:21,961 DEBUG [RS:0;jenkins-hbase4:40317] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:10:21,961 DEBUG [jenkins-hbase4:40453] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 18:10:21,962 DEBUG [jenkins-hbase4:40453] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 18:10:21,962 DEBUG [RS:0;jenkins-hbase4:40317] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:10:21,962 DEBUG [RS:0;jenkins-hbase4:40317] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-19 18:10:21,963 INFO [RS:0;jenkins-hbase4:40317] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-19 18:10:21,963 INFO [RS:0;jenkins-hbase4:40317] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-19 18:10:21,965 INFO [RS:2;jenkins-hbase4:44407] regionserver.Replication(203): jenkins-hbase4.apache.org,44407,1689790219668 started 2023-07-19 18:10:21,965 INFO [RS:2;jenkins-hbase4:44407] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,44407,1689790219668, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:44407, sessionid=0x1017ec6fe090003 2023-07-19 18:10:21,965 DEBUG [RS:2;jenkins-hbase4:44407] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-19 18:10:21,965 DEBUG [RS:1;jenkins-hbase4:33037] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-19 18:10:21,965 DEBUG [RS:2;jenkins-hbase4:44407] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:21,965 DEBUG [RS:2;jenkins-hbase4:44407] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44407,1689790219668' 2023-07-19 18:10:21,966 DEBUG [RS:2;jenkins-hbase4:44407] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-19 18:10:21,966 DEBUG [RS:1;jenkins-hbase4:33037] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-19 18:10:21,967 DEBUG [RS:1;jenkins-hbase4:33037] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-19 18:10:21,966 DEBUG [RS:2;jenkins-hbase4:44407] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-19 18:10:21,967 DEBUG [RS:1;jenkins-hbase4:33037] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:21,969 DEBUG [RS:1;jenkins-hbase4:33037] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33037,1689790219604' 2023-07-19 18:10:21,969 DEBUG [RS:1;jenkins-hbase4:33037] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:10:21,970 DEBUG [RS:2;jenkins-hbase4:44407] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-19 18:10:21,970 DEBUG [RS:2;jenkins-hbase4:44407] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-19 18:10:21,970 DEBUG [RS:2;jenkins-hbase4:44407] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:21,970 DEBUG [RS:1;jenkins-hbase4:33037] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:10:21,970 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,33037,1689790219604, state=OPENING 2023-07-19 18:10:21,970 DEBUG [RS:2;jenkins-hbase4:44407] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44407,1689790219668' 2023-07-19 18:10:21,971 DEBUG [RS:2;jenkins-hbase4:44407] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:10:21,971 DEBUG [RS:1;jenkins-hbase4:33037] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-19 18:10:21,971 INFO [RS:1;jenkins-hbase4:33037] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-19 18:10:21,972 INFO [RS:1;jenkins-hbase4:33037] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-19 18:10:21,973 DEBUG [RS:2;jenkins-hbase4:44407] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:10:21,973 DEBUG [RS:2;jenkins-hbase4:44407] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-19 18:10:21,973 INFO [RS:2;jenkins-hbase4:44407] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-19 18:10:21,973 INFO [RS:2;jenkins-hbase4:44407] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-19 18:10:21,982 DEBUG [PEWorker-2] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-19 18:10:21,984 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 18:10:21,985 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-19 18:10:21,991 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,33037,1689790219604}] 2023-07-19 18:10:22,077 INFO [RS:0;jenkins-hbase4:40317] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40317%2C1689790219525, suffix=, logDir=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/WALs/jenkins-hbase4.apache.org,40317,1689790219525, archiveDir=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/oldWALs, maxLogs=32 2023-07-19 18:10:22,077 INFO [RS:2;jenkins-hbase4:44407] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44407%2C1689790219668, suffix=, logDir=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/WALs/jenkins-hbase4.apache.org,44407,1689790219668, archiveDir=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/oldWALs, maxLogs=32 2023-07-19 18:10:22,082 INFO [RS:1;jenkins-hbase4:33037] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33037%2C1689790219604, suffix=, logDir=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/WALs/jenkins-hbase4.apache.org,33037,1689790219604, archiveDir=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/oldWALs, maxLogs=32 2023-07-19 18:10:22,149 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43551,DS-ae840c29-7966-40fe-84f0-5f57bcdc1c48,DISK] 2023-07-19 18:10:22,150 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37793,DS-2148f4fa-3c80-4f0a-9d47-0b5b3bda69ec,DISK] 2023-07-19 18:10:22,150 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34269,DS-a911110b-c733-494e-b19b-5b9cd476cd41,DISK] 2023-07-19 18:10:22,153 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43551,DS-ae840c29-7966-40fe-84f0-5f57bcdc1c48,DISK] 2023-07-19 18:10:22,153 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37793,DS-2148f4fa-3c80-4f0a-9d47-0b5b3bda69ec,DISK] 2023-07-19 18:10:22,154 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34269,DS-a911110b-c733-494e-b19b-5b9cd476cd41,DISK] 2023-07-19 18:10:22,160 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37793,DS-2148f4fa-3c80-4f0a-9d47-0b5b3bda69ec,DISK] 2023-07-19 18:10:22,160 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34269,DS-a911110b-c733-494e-b19b-5b9cd476cd41,DISK] 2023-07-19 18:10:22,160 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43551,DS-ae840c29-7966-40fe-84f0-5f57bcdc1c48,DISK] 2023-07-19 18:10:22,174 INFO [RS:0;jenkins-hbase4:40317] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/WALs/jenkins-hbase4.apache.org,40317,1689790219525/jenkins-hbase4.apache.org%2C40317%2C1689790219525.1689790222082 2023-07-19 18:10:22,175 INFO [RS:1;jenkins-hbase4:33037] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/WALs/jenkins-hbase4.apache.org,33037,1689790219604/jenkins-hbase4.apache.org%2C33037%2C1689790219604.1689790222084 2023-07-19 18:10:22,178 DEBUG [RS:0;jenkins-hbase4:40317] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34269,DS-a911110b-c733-494e-b19b-5b9cd476cd41,DISK], DatanodeInfoWithStorage[127.0.0.1:43551,DS-ae840c29-7966-40fe-84f0-5f57bcdc1c48,DISK], DatanodeInfoWithStorage[127.0.0.1:37793,DS-2148f4fa-3c80-4f0a-9d47-0b5b3bda69ec,DISK]] 2023-07-19 18:10:22,180 DEBUG [RS:1;jenkins-hbase4:33037] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34269,DS-a911110b-c733-494e-b19b-5b9cd476cd41,DISK], DatanodeInfoWithStorage[127.0.0.1:43551,DS-ae840c29-7966-40fe-84f0-5f57bcdc1c48,DISK], DatanodeInfoWithStorage[127.0.0.1:37793,DS-2148f4fa-3c80-4f0a-9d47-0b5b3bda69ec,DISK]] 2023-07-19 18:10:22,180 INFO [RS:2;jenkins-hbase4:44407] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/WALs/jenkins-hbase4.apache.org,44407,1689790219668/jenkins-hbase4.apache.org%2C44407%2C1689790219668.1689790222081 2023-07-19 18:10:22,182 DEBUG [RS:2;jenkins-hbase4:44407] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37793,DS-2148f4fa-3c80-4f0a-9d47-0b5b3bda69ec,DISK], DatanodeInfoWithStorage[127.0.0.1:34269,DS-a911110b-c733-494e-b19b-5b9cd476cd41,DISK], DatanodeInfoWithStorage[127.0.0.1:43551,DS-ae840c29-7966-40fe-84f0-5f57bcdc1c48,DISK]] 2023-07-19 18:10:22,203 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:22,210 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 18:10:22,215 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39532, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 18:10:22,232 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-19 18:10:22,233 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-19 18:10:22,238 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33037%2C1689790219604.meta, suffix=.meta, logDir=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/WALs/jenkins-hbase4.apache.org,33037,1689790219604, archiveDir=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/oldWALs, maxLogs=32 2023-07-19 18:10:22,267 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43551,DS-ae840c29-7966-40fe-84f0-5f57bcdc1c48,DISK] 2023-07-19 18:10:22,269 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34269,DS-a911110b-c733-494e-b19b-5b9cd476cd41,DISK] 2023-07-19 18:10:22,271 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37793,DS-2148f4fa-3c80-4f0a-9d47-0b5b3bda69ec,DISK] 2023-07-19 18:10:22,286 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/WALs/jenkins-hbase4.apache.org,33037,1689790219604/jenkins-hbase4.apache.org%2C33037%2C1689790219604.meta.1689790222239.meta 2023-07-19 18:10:22,287 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43551,DS-ae840c29-7966-40fe-84f0-5f57bcdc1c48,DISK], DatanodeInfoWithStorage[127.0.0.1:34269,DS-a911110b-c733-494e-b19b-5b9cd476cd41,DISK], DatanodeInfoWithStorage[127.0.0.1:37793,DS-2148f4fa-3c80-4f0a-9d47-0b5b3bda69ec,DISK]] 2023-07-19 18:10:22,287 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-19 18:10:22,288 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-19 18:10:22,290 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 18:10:22,291 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-19 18:10:22,293 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-19 18:10:22,295 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-19 18:10:22,319 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-19 18:10:22,320 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 18:10:22,320 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-19 18:10:22,320 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-19 18:10:22,325 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-19 18:10:22,328 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/hbase/meta/1588230740/info 2023-07-19 18:10:22,328 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/hbase/meta/1588230740/info 2023-07-19 18:10:22,328 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-19 18:10:22,329 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 18:10:22,330 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-19 18:10:22,331 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/hbase/meta/1588230740/rep_barrier 2023-07-19 18:10:22,332 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/hbase/meta/1588230740/rep_barrier 2023-07-19 18:10:22,332 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-19 18:10:22,334 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 18:10:22,334 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-19 18:10:22,336 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/hbase/meta/1588230740/table 2023-07-19 18:10:22,336 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/hbase/meta/1588230740/table 2023-07-19 18:10:22,337 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-19 18:10:22,338 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 18:10:22,340 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/hbase/meta/1588230740 2023-07-19 18:10:22,344 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/hbase/meta/1588230740 2023-07-19 18:10:22,348 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-19 18:10:22,359 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-19 18:10:22,361 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69516705, jitterRate=0.035879626870155334}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-19 18:10:22,364 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-19 18:10:22,378 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689790222193 2023-07-19 18:10:22,409 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-19 18:10:22,422 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,33037,1689790219604, state=OPEN 2023-07-19 18:10:22,439 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-19 18:10:22,441 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-19 18:10:22,442 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-19 18:10:22,450 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-19 18:10:22,451 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,33037,1689790219604 in 450 msec 2023-07-19 18:10:22,463 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-19 18:10:22,463 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 729 msec 2023-07-19 18:10:22,473 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.2820 sec 2023-07-19 18:10:22,473 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689790222473, completionTime=-1 2023-07-19 18:10:22,473 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-19 18:10:22,474 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-19 18:10:22,565 DEBUG [hconnection-0x3af1d18e-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 18:10:22,568 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39542, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 18:10:22,597 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-19 18:10:22,597 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689790282597 2023-07-19 18:10:22,597 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689790342597 2023-07-19 18:10:22,597 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 123 msec 2023-07-19 18:10:22,629 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40453,1689790217932-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 18:10:22,629 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40453,1689790217932-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-19 18:10:22,629 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40453,1689790217932-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-19 18:10:22,631 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:40453, period=300000, unit=MILLISECONDS is enabled. 2023-07-19 18:10:22,632 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-19 18:10:22,641 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-19 18:10:22,652 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-19 18:10:22,654 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-19 18:10:22,672 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-19 18:10:22,675 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 18:10:22,678 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 18:10:22,705 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/hbase/namespace/b30374cc412dfbdda00c47dbbf7094d8 2023-07-19 18:10:22,709 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/hbase/namespace/b30374cc412dfbdda00c47dbbf7094d8 empty. 2023-07-19 18:10:22,710 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/hbase/namespace/b30374cc412dfbdda00c47dbbf7094d8 2023-07-19 18:10:22,711 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-19 18:10:22,765 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-19 18:10:22,771 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => b30374cc412dfbdda00c47dbbf7094d8, NAME => 'hbase:namespace,,1689790222654.b30374cc412dfbdda00c47dbbf7094d8.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp 2023-07-19 18:10:22,797 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689790222654.b30374cc412dfbdda00c47dbbf7094d8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 18:10:22,797 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing b30374cc412dfbdda00c47dbbf7094d8, disabling compactions & flushes 2023-07-19 18:10:22,797 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689790222654.b30374cc412dfbdda00c47dbbf7094d8. 2023-07-19 18:10:22,797 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689790222654.b30374cc412dfbdda00c47dbbf7094d8. 2023-07-19 18:10:22,797 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689790222654.b30374cc412dfbdda00c47dbbf7094d8. after waiting 0 ms 2023-07-19 18:10:22,797 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689790222654.b30374cc412dfbdda00c47dbbf7094d8. 2023-07-19 18:10:22,797 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689790222654.b30374cc412dfbdda00c47dbbf7094d8. 2023-07-19 18:10:22,797 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for b30374cc412dfbdda00c47dbbf7094d8: 2023-07-19 18:10:22,804 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 18:10:22,820 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689790222654.b30374cc412dfbdda00c47dbbf7094d8.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689790222807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689790222807"}]},"ts":"1689790222807"} 2023-07-19 18:10:22,849 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-19 18:10:22,852 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 18:10:22,856 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689790222852"}]},"ts":"1689790222852"} 2023-07-19 18:10:22,861 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-19 18:10:22,866 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 18:10:22,868 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 18:10:22,868 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 18:10:22,868 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 18:10:22,868 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 18:10:22,872 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=b30374cc412dfbdda00c47dbbf7094d8, ASSIGN}] 2023-07-19 18:10:22,876 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=b30374cc412dfbdda00c47dbbf7094d8, ASSIGN 2023-07-19 18:10:22,878 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=b30374cc412dfbdda00c47dbbf7094d8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44407,1689790219668; forceNewPlan=false, retain=false 2023-07-19 18:10:23,031 INFO [jenkins-hbase4:40453] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-19 18:10:23,032 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=b30374cc412dfbdda00c47dbbf7094d8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:23,032 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689790222654.b30374cc412dfbdda00c47dbbf7094d8.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689790223032"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689790223032"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689790223032"}]},"ts":"1689790223032"} 2023-07-19 18:10:23,043 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure b30374cc412dfbdda00c47dbbf7094d8, server=jenkins-hbase4.apache.org,44407,1689790219668}] 2023-07-19 18:10:23,199 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:23,200 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 18:10:23,203 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51138, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 18:10:23,212 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689790222654.b30374cc412dfbdda00c47dbbf7094d8. 2023-07-19 18:10:23,213 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b30374cc412dfbdda00c47dbbf7094d8, NAME => 'hbase:namespace,,1689790222654.b30374cc412dfbdda00c47dbbf7094d8.', STARTKEY => '', ENDKEY => ''} 2023-07-19 18:10:23,213 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689790222654.b30374cc412dfbdda00c47dbbf7094d8. service=AccessControlService 2023-07-19 18:10:23,214 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 18:10:23,215 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace b30374cc412dfbdda00c47dbbf7094d8 2023-07-19 18:10:23,215 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689790222654.b30374cc412dfbdda00c47dbbf7094d8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 18:10:23,215 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b30374cc412dfbdda00c47dbbf7094d8 2023-07-19 18:10:23,215 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b30374cc412dfbdda00c47dbbf7094d8 2023-07-19 18:10:23,217 INFO [StoreOpener-b30374cc412dfbdda00c47dbbf7094d8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region b30374cc412dfbdda00c47dbbf7094d8 2023-07-19 18:10:23,220 DEBUG [StoreOpener-b30374cc412dfbdda00c47dbbf7094d8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/hbase/namespace/b30374cc412dfbdda00c47dbbf7094d8/info 2023-07-19 18:10:23,221 DEBUG [StoreOpener-b30374cc412dfbdda00c47dbbf7094d8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/hbase/namespace/b30374cc412dfbdda00c47dbbf7094d8/info 2023-07-19 18:10:23,221 INFO [StoreOpener-b30374cc412dfbdda00c47dbbf7094d8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b30374cc412dfbdda00c47dbbf7094d8 columnFamilyName info 2023-07-19 18:10:23,222 INFO [StoreOpener-b30374cc412dfbdda00c47dbbf7094d8-1] regionserver.HStore(310): Store=b30374cc412dfbdda00c47dbbf7094d8/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 18:10:23,224 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/hbase/namespace/b30374cc412dfbdda00c47dbbf7094d8 2023-07-19 18:10:23,225 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/hbase/namespace/b30374cc412dfbdda00c47dbbf7094d8 2023-07-19 18:10:23,230 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b30374cc412dfbdda00c47dbbf7094d8 2023-07-19 18:10:23,234 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/hbase/namespace/b30374cc412dfbdda00c47dbbf7094d8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 18:10:23,235 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b30374cc412dfbdda00c47dbbf7094d8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70610067, jitterRate=0.052171990275382996}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 18:10:23,235 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b30374cc412dfbdda00c47dbbf7094d8: 2023-07-19 18:10:23,238 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689790222654.b30374cc412dfbdda00c47dbbf7094d8., pid=6, masterSystemTime=1689790223199 2023-07-19 18:10:23,243 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689790222654.b30374cc412dfbdda00c47dbbf7094d8. 2023-07-19 18:10:23,243 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689790222654.b30374cc412dfbdda00c47dbbf7094d8. 2023-07-19 18:10:23,245 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=b30374cc412dfbdda00c47dbbf7094d8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:23,245 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689790222654.b30374cc412dfbdda00c47dbbf7094d8.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689790223244"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689790223244"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689790223244"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689790223244"}]},"ts":"1689790223244"} 2023-07-19 18:10:23,253 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-19 18:10:23,254 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure b30374cc412dfbdda00c47dbbf7094d8, server=jenkins-hbase4.apache.org,44407,1689790219668 in 206 msec 2023-07-19 18:10:23,258 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-19 18:10:23,259 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=b30374cc412dfbdda00c47dbbf7094d8, ASSIGN in 382 msec 2023-07-19 18:10:23,260 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 18:10:23,261 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689790223260"}]},"ts":"1689790223260"} 2023-07-19 18:10:23,263 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-19 18:10:23,267 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 18:10:23,270 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 611 msec 2023-07-19 18:10:23,274 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-19 18:10:23,276 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-19 18:10:23,276 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 18:10:23,305 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 18:10:23,307 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51144, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 18:10:23,322 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-19 18:10:23,355 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-19 18:10:23,369 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 53 msec 2023-07-19 18:10:23,377 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-19 18:10:23,395 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-19 18:10:23,401 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 24 msec 2023-07-19 18:10:23,423 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-19 18:10:23,426 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-19 18:10:23,427 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.662sec 2023-07-19 18:10:23,436 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-19 18:10:23,437 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-19 18:10:23,438 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-19 18:10:23,439 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40453,1689790217932-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-19 18:10:23,440 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40453,1689790217932-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-19 18:10:23,456 DEBUG [Listener at localhost/41305] zookeeper.ReadOnlyZKClient(139): Connect 0x1370d70b to 127.0.0.1:51604 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 18:10:23,468 DEBUG [Listener at localhost/41305] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6cb4f0a0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 18:10:23,481 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-19 18:10:23,483 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-19 18:10:23,490 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 18:10:23,495 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 18:10:23,495 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-19 18:10:23,498 DEBUG [hconnection-0x67f0b4bd-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 18:10:23,498 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/hbase/acl/6d71765aa8180394c9cda6e0d8592f3e 2023-07-19 18:10:23,500 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/hbase/acl/6d71765aa8180394c9cda6e0d8592f3e empty. 2023-07-19 18:10:23,503 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/hbase/acl/6d71765aa8180394c9cda6e0d8592f3e 2023-07-19 18:10:23,503 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-19 18:10:23,507 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-19 18:10:23,520 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39556, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 18:10:23,525 INFO [Listener at localhost/41305] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,40453,1689790217932 2023-07-19 18:10:23,525 INFO [Listener at localhost/41305] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-19 18:10:23,525 INFO [Listener at localhost/41305] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/test.cache.data in system properties and HBase conf 2023-07-19 18:10:23,525 INFO [Listener at localhost/41305] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/hadoop.tmp.dir in system properties and HBase conf 2023-07-19 18:10:23,525 INFO [Listener at localhost/41305] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/hadoop.log.dir in system properties and HBase conf 2023-07-19 18:10:23,526 INFO [Listener at localhost/41305] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-19 18:10:23,526 INFO [Listener at localhost/41305] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-19 18:10:23,526 INFO [Listener at localhost/41305] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-19 18:10:23,526 INFO [Listener at localhost/41305] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-19 18:10:23,526 INFO [Listener at localhost/41305] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-19 18:10:23,526 INFO [Listener at localhost/41305] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-19 18:10:23,527 INFO [Listener at localhost/41305] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-19 18:10:23,527 INFO [Listener at localhost/41305] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-19 18:10:23,527 INFO [Listener at localhost/41305] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-19 18:10:23,527 INFO [Listener at localhost/41305] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-19 18:10:23,527 INFO [Listener at localhost/41305] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-19 18:10:23,527 INFO [Listener at localhost/41305] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-19 18:10:23,527 INFO [Listener at localhost/41305] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/nfs.dump.dir in system properties and HBase conf 2023-07-19 18:10:23,528 INFO [Listener at localhost/41305] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/java.io.tmpdir in system properties and HBase conf 2023-07-19 18:10:23,528 INFO [Listener at localhost/41305] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-19 18:10:23,528 INFO [Listener at localhost/41305] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-19 18:10:23,528 INFO [Listener at localhost/41305] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-19 18:10:23,569 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-19 18:10:23,571 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6d71765aa8180394c9cda6e0d8592f3e, NAME => 'hbase:acl,,1689790223471.6d71765aa8180394c9cda6e0d8592f3e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp 2023-07-19 18:10:23,629 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-19 18:10:23,652 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689790223471.6d71765aa8180394c9cda6e0d8592f3e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 18:10:23,653 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 6d71765aa8180394c9cda6e0d8592f3e, disabling compactions & flushes 2023-07-19 18:10:23,653 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689790223471.6d71765aa8180394c9cda6e0d8592f3e. 2023-07-19 18:10:23,653 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689790223471.6d71765aa8180394c9cda6e0d8592f3e. 2023-07-19 18:10:23,653 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689790223471.6d71765aa8180394c9cda6e0d8592f3e. after waiting 0 ms 2023-07-19 18:10:23,653 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689790223471.6d71765aa8180394c9cda6e0d8592f3e. 2023-07-19 18:10:23,654 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689790223471.6d71765aa8180394c9cda6e0d8592f3e. 2023-07-19 18:10:23,654 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 6d71765aa8180394c9cda6e0d8592f3e: 2023-07-19 18:10:23,663 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 18:10:23,665 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689790223471.6d71765aa8180394c9cda6e0d8592f3e.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689790223665"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689790223665"}]},"ts":"1689790223665"} 2023-07-19 18:10:23,671 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-19 18:10:23,675 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 18:10:23,675 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689790223675"}]},"ts":"1689790223675"} 2023-07-19 18:10:23,679 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-19 18:10:23,685 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 18:10:23,686 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 18:10:23,686 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 18:10:23,686 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 18:10:23,687 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 18:10:23,687 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=6d71765aa8180394c9cda6e0d8592f3e, ASSIGN}] 2023-07-19 18:10:23,695 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=6d71765aa8180394c9cda6e0d8592f3e, ASSIGN 2023-07-19 18:10:23,699 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=6d71765aa8180394c9cda6e0d8592f3e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33037,1689790219604; forceNewPlan=false, retain=false 2023-07-19 18:10:23,831 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-19 18:10:23,849 INFO [jenkins-hbase4:40453] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-19 18:10:23,851 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=6d71765aa8180394c9cda6e0d8592f3e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:23,852 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689790223471.6d71765aa8180394c9cda6e0d8592f3e.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689790223851"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689790223851"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689790223851"}]},"ts":"1689790223851"} 2023-07-19 18:10:23,857 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 6d71765aa8180394c9cda6e0d8592f3e, server=jenkins-hbase4.apache.org,33037,1689790219604}] 2023-07-19 18:10:24,020 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689790223471.6d71765aa8180394c9cda6e0d8592f3e. 2023-07-19 18:10:24,021 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6d71765aa8180394c9cda6e0d8592f3e, NAME => 'hbase:acl,,1689790223471.6d71765aa8180394c9cda6e0d8592f3e.', STARTKEY => '', ENDKEY => ''} 2023-07-19 18:10:24,021 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689790223471.6d71765aa8180394c9cda6e0d8592f3e. service=AccessControlService 2023-07-19 18:10:24,021 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 18:10:24,022 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 6d71765aa8180394c9cda6e0d8592f3e 2023-07-19 18:10:24,022 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689790223471.6d71765aa8180394c9cda6e0d8592f3e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 18:10:24,022 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6d71765aa8180394c9cda6e0d8592f3e 2023-07-19 18:10:24,022 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6d71765aa8180394c9cda6e0d8592f3e 2023-07-19 18:10:24,024 INFO [StoreOpener-6d71765aa8180394c9cda6e0d8592f3e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 6d71765aa8180394c9cda6e0d8592f3e 2023-07-19 18:10:24,026 DEBUG [StoreOpener-6d71765aa8180394c9cda6e0d8592f3e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/hbase/acl/6d71765aa8180394c9cda6e0d8592f3e/l 2023-07-19 18:10:24,027 DEBUG [StoreOpener-6d71765aa8180394c9cda6e0d8592f3e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/hbase/acl/6d71765aa8180394c9cda6e0d8592f3e/l 2023-07-19 18:10:24,027 INFO [StoreOpener-6d71765aa8180394c9cda6e0d8592f3e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6d71765aa8180394c9cda6e0d8592f3e columnFamilyName l 2023-07-19 18:10:24,028 INFO [StoreOpener-6d71765aa8180394c9cda6e0d8592f3e-1] regionserver.HStore(310): Store=6d71765aa8180394c9cda6e0d8592f3e/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 18:10:24,030 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/hbase/acl/6d71765aa8180394c9cda6e0d8592f3e 2023-07-19 18:10:24,031 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/hbase/acl/6d71765aa8180394c9cda6e0d8592f3e 2023-07-19 18:10:24,036 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6d71765aa8180394c9cda6e0d8592f3e 2023-07-19 18:10:24,047 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/hbase/acl/6d71765aa8180394c9cda6e0d8592f3e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 18:10:24,048 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6d71765aa8180394c9cda6e0d8592f3e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66820835, jitterRate=-0.004291966557502747}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 18:10:24,049 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6d71765aa8180394c9cda6e0d8592f3e: 2023-07-19 18:10:24,051 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689790223471.6d71765aa8180394c9cda6e0d8592f3e., pid=11, masterSystemTime=1689790224012 2023-07-19 18:10:24,055 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689790223471.6d71765aa8180394c9cda6e0d8592f3e. 2023-07-19 18:10:24,055 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689790223471.6d71765aa8180394c9cda6e0d8592f3e. 2023-07-19 18:10:24,056 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=6d71765aa8180394c9cda6e0d8592f3e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:24,057 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689790223471.6d71765aa8180394c9cda6e0d8592f3e.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689790224056"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689790224056"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689790224056"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689790224056"}]},"ts":"1689790224056"} 2023-07-19 18:10:24,064 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-19 18:10:24,064 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 6d71765aa8180394c9cda6e0d8592f3e, server=jenkins-hbase4.apache.org,33037,1689790219604 in 203 msec 2023-07-19 18:10:24,068 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-19 18:10:24,068 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=6d71765aa8180394c9cda6e0d8592f3e, ASSIGN in 377 msec 2023-07-19 18:10:24,069 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 18:10:24,070 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689790224069"}]},"ts":"1689790224069"} 2023-07-19 18:10:24,073 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-19 18:10:24,077 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 18:10:24,080 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 596 msec 2023-07-19 18:10:24,131 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-19 18:10:24,131 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-19 18:10:24,147 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-19 18:10:24,890 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 18:10:25,207 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 18:10:25,213 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_39685_jobhistory____.vowqa2/webapp 2023-07-19 18:10:25,392 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-19 18:10:25,393 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-19 18:10:25,393 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-19 18:10:25,396 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-19 18:10:25,473 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 18:10:25,818 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 18:10:26,275 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-19 18:10:26,314 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:39685 2023-07-19 18:10:26,387 WARN [Listener at jenkins-hbase4.apache.org/45297] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 18:10:26,688 WARN [Listener at jenkins-hbase4.apache.org/45297] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-19 18:10:26,689 INFO [Listener at jenkins-hbase4.apache.org/45297] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 18:10:26,700 INFO [Listener at jenkins-hbase4.apache.org/45297] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_36635_cluster____.77qdt/webapp 2023-07-19 18:10:26,780 INFO [Listener at jenkins-hbase4.apache.org/45297] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-19 18:10:26,781 INFO [Listener at jenkins-hbase4.apache.org/45297] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-19 18:10:26,781 INFO [Listener at jenkins-hbase4.apache.org/45297] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-19 18:10:26,781 INFO [Listener at jenkins-hbase4.apache.org/45297] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-19 18:10:26,793 INFO [Listener at jenkins-hbase4.apache.org/45297] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 18:10:26,990 INFO [Listener at jenkins-hbase4.apache.org/45297] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 18:10:27,087 INFO [Listener at jenkins-hbase4.apache.org/45297] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 18:10:27,093 INFO [Listener at jenkins-hbase4.apache.org/45297] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:36635 2023-07-19 18:10:27,654 WARN [Listener at jenkins-hbase4.apache.org/33271] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 18:10:27,679 WARN [Listener at jenkins-hbase4.apache.org/33271] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-19 18:10:27,680 INFO [Listener at jenkins-hbase4.apache.org/33271] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 18:10:27,686 INFO [Listener at jenkins-hbase4.apache.org/33271] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_46093_node____brdh3a/webapp 2023-07-19 18:10:27,739 INFO [Listener at jenkins-hbase4.apache.org/33271] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-19 18:10:27,739 INFO [Listener at jenkins-hbase4.apache.org/33271] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-19 18:10:27,739 INFO [Listener at jenkins-hbase4.apache.org/33271] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-19 18:10:27,739 INFO [Listener at jenkins-hbase4.apache.org/33271] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-19 18:10:27,749 INFO [Listener at jenkins-hbase4.apache.org/33271] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 18:10:27,768 INFO [Listener at jenkins-hbase4.apache.org/33271] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 18:10:27,860 INFO [Listener at jenkins-hbase4.apache.org/33271] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 18:10:27,873 INFO [Listener at jenkins-hbase4.apache.org/33271] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:46093 2023-07-19 18:10:27,936 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 18:10:28,115 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-19 18:10:28,117 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-19 18:10:28,118 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-19 18:10:28,192 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 18:10:28,199 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-19 18:10:28,202 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 18:10:28,202 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-19 18:10:28,202 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-19 18:10:28,202 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-19 18:10:28,211 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 18:10:28,211 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-19 18:10:28,211 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-19 18:10:28,211 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-19 18:10:28,273 WARN [Listener at jenkins-hbase4.apache.org/42301] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 18:10:28,280 WARN [Listener at jenkins-hbase4.apache.org/42301] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-19 18:10:28,281 INFO [Listener at jenkins-hbase4.apache.org/42301] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 18:10:28,290 INFO [Listener at jenkins-hbase4.apache.org/42301] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_35453_node____.kd49le/webapp 2023-07-19 18:10:28,351 INFO [Listener at jenkins-hbase4.apache.org/42301] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-19 18:10:28,351 INFO [Listener at jenkins-hbase4.apache.org/42301] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-19 18:10:28,351 INFO [Listener at jenkins-hbase4.apache.org/42301] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-19 18:10:28,351 INFO [Listener at jenkins-hbase4.apache.org/42301] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-19 18:10:28,361 INFO [Listener at jenkins-hbase4.apache.org/42301] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 18:10:28,379 INFO [Listener at jenkins-hbase4.apache.org/42301] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 18:10:28,473 INFO [Listener at jenkins-hbase4.apache.org/42301] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 18:10:28,498 INFO [Listener at jenkins-hbase4.apache.org/42301] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:35453 2023-07-19 18:10:28,540 INFO [Listener at jenkins-hbase4.apache.org/42301] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-19 18:10:28,542 INFO [Listener at jenkins-hbase4.apache.org/42301] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 18:10:28,628 INFO [Listener at jenkins-hbase4.apache.org/42301] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=707, OpenFileDescriptor=915, MaxFileDescriptor=60000, SystemLoadAverage=396, ProcessCount=177, AvailableMemoryMB=4971 2023-07-19 18:10:28,629 WARN [Listener at jenkins-hbase4.apache.org/42301] hbase.ResourceChecker(130): Thread=707 is superior to 500 2023-07-19 18:10:28,642 DEBUG [Listener at jenkins-hbase4.apache.org/42301] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-19 18:10:28,648 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58448, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-19 18:10:28,655 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-19 18:10:28,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-19 18:10:28,661 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 18:10:28,661 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-19 18:10:28,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-19 18:10:28,665 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 18:10:28,673 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportWithTargetName/a1439a0513f4736a3a6e29e97a527660 2023-07-19 18:10:28,673 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportWithTargetName/2d060c9134b0e7b667378bd04af8c2f8 2023-07-19 18:10:28,674 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportWithTargetName/a1439a0513f4736a3a6e29e97a527660 empty. 2023-07-19 18:10:28,674 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportWithTargetName/2d060c9134b0e7b667378bd04af8c2f8 empty. 2023-07-19 18:10:28,676 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportWithTargetName/a1439a0513f4736a3a6e29e97a527660 2023-07-19 18:10:28,677 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportWithTargetName/2d060c9134b0e7b667378bd04af8c2f8 2023-07-19 18:10:28,677 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-19 18:10:28,711 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-19 18:10:28,712 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => a1439a0513f4736a3a6e29e97a527660, NAME => 'testtb-testExportWithTargetName,,1689790228654.a1439a0513f4736a3a6e29e97a527660.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp 2023-07-19 18:10:28,715 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 2d060c9134b0e7b667378bd04af8c2f8, NAME => 'testtb-testExportWithTargetName,1,1689790228654.2d060c9134b0e7b667378bd04af8c2f8.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp 2023-07-19 18:10:28,749 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689790228654.a1439a0513f4736a3a6e29e97a527660.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 18:10:28,751 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing a1439a0513f4736a3a6e29e97a527660, disabling compactions & flushes 2023-07-19 18:10:28,751 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689790228654.a1439a0513f4736a3a6e29e97a527660. 2023-07-19 18:10:28,751 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689790228654.a1439a0513f4736a3a6e29e97a527660. 2023-07-19 18:10:28,751 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689790228654.a1439a0513f4736a3a6e29e97a527660. after waiting 0 ms 2023-07-19 18:10:28,752 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689790228654.a1439a0513f4736a3a6e29e97a527660. 2023-07-19 18:10:28,752 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689790228654.a1439a0513f4736a3a6e29e97a527660. 2023-07-19 18:10:28,752 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for a1439a0513f4736a3a6e29e97a527660: 2023-07-19 18:10:28,753 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689790228654.2d060c9134b0e7b667378bd04af8c2f8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 18:10:28,754 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 2d060c9134b0e7b667378bd04af8c2f8, disabling compactions & flushes 2023-07-19 18:10:28,755 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689790228654.2d060c9134b0e7b667378bd04af8c2f8. 2023-07-19 18:10:28,755 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689790228654.2d060c9134b0e7b667378bd04af8c2f8. 2023-07-19 18:10:28,755 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689790228654.2d060c9134b0e7b667378bd04af8c2f8. after waiting 0 ms 2023-07-19 18:10:28,755 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689790228654.2d060c9134b0e7b667378bd04af8c2f8. 2023-07-19 18:10:28,755 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689790228654.2d060c9134b0e7b667378bd04af8c2f8. 2023-07-19 18:10:28,755 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 2d060c9134b0e7b667378bd04af8c2f8: 2023-07-19 18:10:28,759 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 18:10:28,760 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689790228654.a1439a0513f4736a3a6e29e97a527660.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689790228760"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689790228760"}]},"ts":"1689790228760"} 2023-07-19 18:10:28,761 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689790228654.2d060c9134b0e7b667378bd04af8c2f8.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689790228760"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689790228760"}]},"ts":"1689790228760"} 2023-07-19 18:10:28,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-19 18:10:28,814 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 18:10:28,816 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 18:10:28,816 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689790228816"}]},"ts":"1689790228816"} 2023-07-19 18:10:28,818 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-19 18:10:28,824 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 18:10:28,826 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 18:10:28,826 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 18:10:28,826 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 18:10:28,826 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 18:10:28,826 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a1439a0513f4736a3a6e29e97a527660, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=2d060c9134b0e7b667378bd04af8c2f8, ASSIGN}] 2023-07-19 18:10:28,829 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=2d060c9134b0e7b667378bd04af8c2f8, ASSIGN 2023-07-19 18:10:28,830 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a1439a0513f4736a3a6e29e97a527660, ASSIGN 2023-07-19 18:10:28,831 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=2d060c9134b0e7b667378bd04af8c2f8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40317,1689790219525; forceNewPlan=false, retain=false 2023-07-19 18:10:28,831 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a1439a0513f4736a3a6e29e97a527660, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33037,1689790219604; forceNewPlan=false, retain=false 2023-07-19 18:10:28,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-19 18:10:28,982 INFO [jenkins-hbase4:40453] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 18:10:28,984 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=2d060c9134b0e7b667378bd04af8c2f8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:28,984 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=a1439a0513f4736a3a6e29e97a527660, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:28,985 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689790228654.2d060c9134b0e7b667378bd04af8c2f8.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689790228984"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689790228984"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689790228984"}]},"ts":"1689790228984"} 2023-07-19 18:10:28,985 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689790228654.a1439a0513f4736a3a6e29e97a527660.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689790228984"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689790228984"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689790228984"}]},"ts":"1689790228984"} 2023-07-19 18:10:28,988 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure 2d060c9134b0e7b667378bd04af8c2f8, server=jenkins-hbase4.apache.org,40317,1689790219525}] 2023-07-19 18:10:28,990 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure a1439a0513f4736a3a6e29e97a527660, server=jenkins-hbase4.apache.org,33037,1689790219604}] 2023-07-19 18:10:29,143 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:29,143 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 18:10:29,149 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56886, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 18:10:29,155 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689790228654.a1439a0513f4736a3a6e29e97a527660. 2023-07-19 18:10:29,157 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a1439a0513f4736a3a6e29e97a527660, NAME => 'testtb-testExportWithTargetName,,1689790228654.a1439a0513f4736a3a6e29e97a527660.', STARTKEY => '', ENDKEY => '1'} 2023-07-19 18:10:29,157 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689790228654.a1439a0513f4736a3a6e29e97a527660. service=AccessControlService 2023-07-19 18:10:29,157 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 18:10:29,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName a1439a0513f4736a3a6e29e97a527660 2023-07-19 18:10:29,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689790228654.a1439a0513f4736a3a6e29e97a527660.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 18:10:29,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a1439a0513f4736a3a6e29e97a527660 2023-07-19 18:10:29,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a1439a0513f4736a3a6e29e97a527660 2023-07-19 18:10:29,163 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689790228654.2d060c9134b0e7b667378bd04af8c2f8. 2023-07-19 18:10:29,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2d060c9134b0e7b667378bd04af8c2f8, NAME => 'testtb-testExportWithTargetName,1,1689790228654.2d060c9134b0e7b667378bd04af8c2f8.', STARTKEY => '1', ENDKEY => ''} 2023-07-19 18:10:29,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689790228654.2d060c9134b0e7b667378bd04af8c2f8. service=AccessControlService 2023-07-19 18:10:29,163 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 18:10:29,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 2d060c9134b0e7b667378bd04af8c2f8 2023-07-19 18:10:29,164 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689790228654.2d060c9134b0e7b667378bd04af8c2f8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 18:10:29,164 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2d060c9134b0e7b667378bd04af8c2f8 2023-07-19 18:10:29,164 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2d060c9134b0e7b667378bd04af8c2f8 2023-07-19 18:10:29,164 INFO [StoreOpener-a1439a0513f4736a3a6e29e97a527660-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a1439a0513f4736a3a6e29e97a527660 2023-07-19 18:10:29,166 INFO [StoreOpener-2d060c9134b0e7b667378bd04af8c2f8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2d060c9134b0e7b667378bd04af8c2f8 2023-07-19 18:10:29,166 DEBUG [StoreOpener-a1439a0513f4736a3a6e29e97a527660-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportWithTargetName/a1439a0513f4736a3a6e29e97a527660/cf 2023-07-19 18:10:29,166 DEBUG [StoreOpener-a1439a0513f4736a3a6e29e97a527660-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportWithTargetName/a1439a0513f4736a3a6e29e97a527660/cf 2023-07-19 18:10:29,168 DEBUG [StoreOpener-2d060c9134b0e7b667378bd04af8c2f8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportWithTargetName/2d060c9134b0e7b667378bd04af8c2f8/cf 2023-07-19 18:10:29,168 DEBUG [StoreOpener-2d060c9134b0e7b667378bd04af8c2f8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportWithTargetName/2d060c9134b0e7b667378bd04af8c2f8/cf 2023-07-19 18:10:29,168 INFO [StoreOpener-2d060c9134b0e7b667378bd04af8c2f8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2d060c9134b0e7b667378bd04af8c2f8 columnFamilyName cf 2023-07-19 18:10:29,169 INFO [StoreOpener-2d060c9134b0e7b667378bd04af8c2f8-1] regionserver.HStore(310): Store=2d060c9134b0e7b667378bd04af8c2f8/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 18:10:29,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportWithTargetName/2d060c9134b0e7b667378bd04af8c2f8 2023-07-19 18:10:29,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportWithTargetName/2d060c9134b0e7b667378bd04af8c2f8 2023-07-19 18:10:29,179 INFO [StoreOpener-a1439a0513f4736a3a6e29e97a527660-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a1439a0513f4736a3a6e29e97a527660 columnFamilyName cf 2023-07-19 18:10:29,184 INFO [StoreOpener-a1439a0513f4736a3a6e29e97a527660-1] regionserver.HStore(310): Store=a1439a0513f4736a3a6e29e97a527660/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 18:10:29,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2d060c9134b0e7b667378bd04af8c2f8 2023-07-19 18:10:29,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportWithTargetName/a1439a0513f4736a3a6e29e97a527660 2023-07-19 18:10:29,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportWithTargetName/a1439a0513f4736a3a6e29e97a527660 2023-07-19 18:10:29,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportWithTargetName/2d060c9134b0e7b667378bd04af8c2f8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 18:10:29,196 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2d060c9134b0e7b667378bd04af8c2f8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65612305, jitterRate=-0.022300466895103455}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 18:10:29,196 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2d060c9134b0e7b667378bd04af8c2f8: 2023-07-19 18:10:29,198 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689790228654.2d060c9134b0e7b667378bd04af8c2f8., pid=15, masterSystemTime=1689790229143 2023-07-19 18:10:29,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a1439a0513f4736a3a6e29e97a527660 2023-07-19 18:10:29,221 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689790228654.2d060c9134b0e7b667378bd04af8c2f8. 2023-07-19 18:10:29,222 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=2d060c9134b0e7b667378bd04af8c2f8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:29,223 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689790228654.2d060c9134b0e7b667378bd04af8c2f8.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689790229222"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689790229222"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689790229222"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689790229222"}]},"ts":"1689790229222"} 2023-07-19 18:10:29,229 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689790228654.2d060c9134b0e7b667378bd04af8c2f8. 2023-07-19 18:10:29,230 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportWithTargetName/a1439a0513f4736a3a6e29e97a527660/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 18:10:29,234 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a1439a0513f4736a3a6e29e97a527660; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60631627, jitterRate=-0.09651835262775421}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 18:10:29,234 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a1439a0513f4736a3a6e29e97a527660: 2023-07-19 18:10:29,236 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689790228654.a1439a0513f4736a3a6e29e97a527660., pid=16, masterSystemTime=1689790229144 2023-07-19 18:10:29,238 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-07-19 18:10:29,240 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure 2d060c9134b0e7b667378bd04af8c2f8, server=jenkins-hbase4.apache.org,40317,1689790219525 in 238 msec 2023-07-19 18:10:29,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689790228654.a1439a0513f4736a3a6e29e97a527660. 2023-07-19 18:10:29,241 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689790228654.a1439a0513f4736a3a6e29e97a527660. 2023-07-19 18:10:29,242 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=a1439a0513f4736a3a6e29e97a527660, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:29,242 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689790228654.a1439a0513f4736a3a6e29e97a527660.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689790229242"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689790229242"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689790229242"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689790229242"}]},"ts":"1689790229242"} 2023-07-19 18:10:29,243 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=2d060c9134b0e7b667378bd04af8c2f8, ASSIGN in 412 msec 2023-07-19 18:10:29,248 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=13 2023-07-19 18:10:29,250 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure a1439a0513f4736a3a6e29e97a527660, server=jenkins-hbase4.apache.org,33037,1689790219604 in 255 msec 2023-07-19 18:10:29,268 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-19 18:10:29,268 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a1439a0513f4736a3a6e29e97a527660, ASSIGN in 422 msec 2023-07-19 18:10:29,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-19 18:10:29,270 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 18:10:29,270 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689790229270"}]},"ts":"1689790229270"} 2023-07-19 18:10:29,273 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-19 18:10:29,277 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 18:10:29,284 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-19 18:10:29,337 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33037] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-19 18:10:29,387 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-19 18:10:29,387 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-19 18:10:29,387 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 18:10:29,387 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-19 18:10:29,389 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-19 18:10:29,401 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 18:10:29,401 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 18:10:29,410 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 18:10:29,410 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 18:10:29,411 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-19 18:10:29,412 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-19 18:10:29,412 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-19 18:10:29,412 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-19 18:10:29,423 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 756 msec 2023-07-19 18:10:29,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-19 18:10:29,772 INFO [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-19 18:10:29,772 DEBUG [Listener at jenkins-hbase4.apache.org/42301] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportWithTargetName get assigned. Timeout = 60000ms 2023-07-19 18:10:29,773 INFO [Listener at jenkins-hbase4.apache.org/42301] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 18:10:29,779 INFO [Listener at jenkins-hbase4.apache.org/42301] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportWithTargetName assigned to meta. Checking AM states. 2023-07-19 18:10:29,780 INFO [Listener at jenkins-hbase4.apache.org/42301] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 18:10:29,780 INFO [Listener at jenkins-hbase4.apache.org/42301] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportWithTargetName assigned. 2023-07-19 18:10:29,798 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-19 18:10:29,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689790229798 (current time:1689790229798). 2023-07-19 18:10:29,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 18:10:29,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] zookeeper.ReadOnlyZKClient(139): Connect 0x7e79efcf to 127.0.0.1:51604 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 18:10:29,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5007f0e3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 18:10:29,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 18:10:29,819 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39564, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 18:10:29,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7e79efcf to 127.0.0.1:51604 2023-07-19 18:10:29,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 18:10:29,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] zookeeper.ReadOnlyZKClient(139): Connect 0x054dd0f5 to 127.0.0.1:51604 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 18:10:29,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@180cd9a6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 18:10:29,839 DEBUG [hconnection-0x11c65ac6-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 18:10:29,845 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39566, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 18:10:29,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x054dd0f5 to 127.0.0.1:51604 2023-07-19 18:10:29,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 18:10:29,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-19 18:10:29,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 18:10:29,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-19 18:10:29,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-19 18:10:29,906 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-19 18:10:29,907 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689790829907 2023-07-19 18:10:29,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-19 18:10:29,907 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-19 18:10:29,911 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-19 18:10:29,913 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-19 18:10:29,917 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 16 msec 2023-07-19 18:10:29,918 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-19 18:10:29,919 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 18:10:29,919 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 18:10:29,921 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689790829921 2023-07-19 18:10:29,969 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-19 18:10:29,969 INFO [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-19 18:10:29,969 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 18:10:29,970 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-19 18:10:29,970 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-19 18:10:29,971 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 18:10:29,971 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 18:10:29,977 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:10:29,977 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:10:29,978 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:29,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:10:29,977 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:10:29,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:10:29,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:10:29,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:10:29,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:10:29,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:10:29,978 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:29,978 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:29,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 18:10:29,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 18:10:29,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 18:10:29,979 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:29,979 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 18:10:29,979 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 18:10:29,979 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 18:10:29,979 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 18:10:29,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-19 18:10:29,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-19 18:10:29,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 18:10:29,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 18:10:29,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-19 18:10:29,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 18:10:29,980 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-19 18:10:29,980 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-19 18:10:29,980 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-19 18:10:29,983 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-19 18:10:29,983 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-19 18:10:29,983 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-19 18:10:29,983 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-19 18:10:29,983 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-19 18:10:29,983 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-19 18:10:29,983 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 18:10:29,983 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 18:10:29,985 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-19 18:10:29,985 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-19 18:10:29,983 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 18:10:29,985 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33037,1689790219604' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-19 18:10:29,985 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-19 18:10:29,986 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-19 18:10:29,986 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44407,1689790219668' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-19 18:10:29,986 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-19 18:10:29,986 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-19 18:10:29,986 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40317,1689790219525' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-19 18:10:29,989 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:29,989 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 18:10:29,989 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 18:10:29,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:29,989 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:29,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 18:10:29,990 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 18:10:29,989 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 18:10:29,990 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 18:10:29,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 18:10:29,990 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 18:10:29,990 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 18:10:29,990 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 18:10:29,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 18:10:29,990 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 18:10:29,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 18:10:29,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 18:10:29,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:29,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:29,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:29,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 18:10:29,993 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33037,1689790219604' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-19 18:10:29,993 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4cac937a[Count = 1] remaining members to acquire global barrier 2023-07-19 18:10:29,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:29,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 18:10:29,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 18:10:29,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 18:10:29,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 18:10:29,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 18:10:29,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:29,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:29,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:29,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 18:10:29,999 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40317,1689790219525' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-19 18:10:29,999 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4cac937a[Count = 0] remaining members to acquire global barrier 2023-07-19 18:10:29,999 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-19 18:10:30,000 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 18:10:30,002 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 18:10:30,002 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 18:10:30,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 18:10:30,002 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 18:10:30,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 18:10:30,003 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 18:10:30,003 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 18:10:30,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 18:10:30,003 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:30,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 18:10:30,003 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-19 18:10:30,003 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-19 18:10:30,003 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-19 18:10:30,003 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-19 18:10:30,003 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,44407,1689790219668' in zk 2023-07-19 18:10:30,004 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:30,004 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 18:10:30,005 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 18:10:30,005 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 18:10:30,005 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689790228654.2d060c9134b0e7b667378bd04af8c2f8. 2023-07-19 18:10:30,005 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 18:10:30,007 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 18:10:30,005 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689790228654.a1439a0513f4736a3a6e29e97a527660. 2023-07-19 18:10:30,007 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-19 18:10:30,007 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 18:10:30,007 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-19 18:10:30,007 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689790228654.a1439a0513f4736a3a6e29e97a527660. started... 2023-07-19 18:10:30,008 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689790228654.2d060c9134b0e7b667378bd04af8c2f8. started... 2023-07-19 18:10:30,011 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a1439a0513f4736a3a6e29e97a527660: 2023-07-19 18:10:30,011 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2d060c9134b0e7b667378bd04af8c2f8: 2023-07-19 18:10:30,012 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689790228654.a1439a0513f4736a3a6e29e97a527660.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-19 18:10:30,012 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689790228654.2d060c9134b0e7b667378bd04af8c2f8.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-19 18:10:30,018 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 18:10:30,018 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 18:10:30,019 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 18:10:30,023 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 18:10:30,023 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 18:10:30,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 18:10:30,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-19 18:10:30,029 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 18:10:30,057 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689790228654.2d060c9134b0e7b667378bd04af8c2f8. completed. 2023-07-19 18:10:30,058 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689790228654.2d060c9134b0e7b667378bd04af8c2f8. 2023-07-19 18:10:30,058 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 18:10:30,058 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 18:10:30,058 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689790228654.a1439a0513f4736a3a6e29e97a527660. completed. 2023-07-19 18:10:30,058 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:30,058 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689790228654.a1439a0513f4736a3a6e29e97a527660. 2023-07-19 18:10:30,058 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-19 18:10:30,058 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 18:10:30,059 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 18:10:30,059 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:30,058 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,40317,1689790219525' in zk 2023-07-19 18:10:30,059 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-19 18:10:30,059 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,33037,1689790219604' in zk 2023-07-19 18:10:30,061 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-19 18:10:30,061 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:30,061 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 18:10:30,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:30,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 18:10:30,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 18:10:30,062 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-19 18:10:30,061 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-19 18:10:30,062 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 18:10:30,062 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:30,062 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-19 18:10:30,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 18:10:30,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 18:10:30,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 18:10:30,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:30,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:30,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:30,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 18:10:30,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 18:10:30,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:30,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:30,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:30,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,33037,1689790219604': 2023-07-19 18:10:30,068 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33037,1689790219604' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-19 18:10:30,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:30,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 18:10:30,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 18:10:30,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 18:10:30,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 18:10:30,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 18:10:30,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:30,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:30,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:30,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 18:10:30,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 18:10:30,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:30,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:30,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:30,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,40317,1689790219525': 2023-07-19 18:10:30,073 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40317,1689790219525' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-19 18:10:30,073 INFO [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-19 18:10:30,073 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 18:10:30,073 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 18:10:30,073 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-19 18:10:30,073 INFO [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 18:10:30,077 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 18:10:30,077 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 18:10:30,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 18:10:30,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 18:10:30,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 18:10:30,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 18:10:30,078 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 18:10:30,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 18:10:30,078 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 18:10:30,078 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:10:30,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 18:10:30,078 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:10:30,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 18:10:30,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 18:10:30,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:10:30,078 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:10:30,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:10:30,078 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:30,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 18:10:30,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 18:10:30,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 18:10:30,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 18:10:30,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:10:30,079 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:30,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:10:30,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:10:30,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:10:30,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 18:10:30,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 18:10:30,082 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:30,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 18:10:30,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 18:10:30,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:30,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:30,084 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:30,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:30,085 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:30,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 18:10:30,086 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:30,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 18:10:30,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:30,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:30,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:30,098 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:30,099 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:10:30,099 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:10:30,099 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 18:10:30,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:10:30,099 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:30,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:10:30,099 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:10:30,099 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:10:30,099 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:10:30,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:10:30,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:10:30,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:10:30,099 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-19 18:10:30,099 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 18:10:30,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:10:30,100 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-19 18:10:30,099 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:10:30,099 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:30,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:10:30,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:10:30,100 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 18:10:30,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:10:30,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:10:30,101 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:30,101 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 18:10:30,101 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:30,101 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:30,101 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 18:10:30,101 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 18:10:30,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:10:30,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:10:30,103 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-19 18:10:30,144 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-19 18:10:30,204 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-19 18:10:30,204 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-19 18:10:30,204 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-19 18:10:30,205 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689790229908Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689790230099 (+191 ms)Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689790230100 (+1 ms)Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689790230114 (+14 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689790230132 (+18 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689790230204 (+72 ms) 2023-07-19 18:10:30,209 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-19 18:10:30,211 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 298 msec 2023-07-19 18:10:30,229 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 18:10:30,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 18:10:30,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 18:10:30,252 DEBUG [htable-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 18:10:30,257 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33037] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689790228654.a1439a0513f4736a3a6e29e97a527660. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 18:10:30,273 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56898, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 18:10:30,276 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40317] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689790228654.2d060c9134b0e7b667378bd04af8c2f8. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 18:10:30,281 DEBUG [Listener at jenkins-hbase4.apache.org/42301] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-19 18:10:30,283 DEBUG [Listener at jenkins-hbase4.apache.org/42301] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689790228654.a1439a0513f4736a3a6e29e97a527660. 2023-07-19 18:10:30,285 INFO [Listener at jenkins-hbase4.apache.org/42301] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 18:10:30,319 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-19 18:10:30,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689790230319 (current time:1689790230319). 2023-07-19 18:10:30,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 18:10:30,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] zookeeper.ReadOnlyZKClient(139): Connect 0x55c0c3ce to 127.0.0.1:51604 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 18:10:30,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@59411110, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 18:10:30,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 18:10:30,329 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42488, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 18:10:30,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x55c0c3ce to 127.0.0.1:51604 2023-07-19 18:10:30,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 18:10:30,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] zookeeper.ReadOnlyZKClient(139): Connect 0x28debd1b to 127.0.0.1:51604 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 18:10:30,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7b53c57d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 18:10:30,342 DEBUG [hconnection-0x2a4b8296-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 18:10:30,345 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42500, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 18:10:30,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x28debd1b to 127.0.0.1:51604 2023-07-19 18:10:30,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 18:10:30,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-19 18:10:30,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 18:10:30,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-19 18:10:30,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-19 18:10:30,358 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-19 18:10:30,360 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689790830360 2023-07-19 18:10:30,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-19 18:10:30,360 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-19 18:10:30,360 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 18:10:30,361 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 18:10:30,364 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-19 18:10:30,364 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-19 18:10:30,366 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 9 msec 2023-07-19 18:10:30,368 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-19 18:10:30,369 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689790830369 2023-07-19 18:10:30,398 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-19 18:10:30,398 INFO [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-19 18:10:30,398 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 18:10:30,400 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-19 18:10:30,400 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-19 18:10:30,400 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 18:10:30,401 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 18:10:30,402 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:10:30,402 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:30,403 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:10:30,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:10:30,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:10:30,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:10:30,403 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:10:30,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:10:30,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:10:30,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:10:30,403 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:30,403 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:30,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 18:10:30,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 18:10:30,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 18:10:30,404 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 18:10:30,404 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:30,404 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 18:10:30,404 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 18:10:30,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-19 18:10:30,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 18:10:30,405 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 18:10:30,405 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-19 18:10:30,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-19 18:10:30,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 18:10:30,405 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-19 18:10:30,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-19 18:10:30,405 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-19 18:10:30,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 18:10:30,405 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-19 18:10:30,405 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 18:10:30,405 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-19 18:10:30,406 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-19 18:10:30,413 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-19 18:10:30,408 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-19 18:10:30,413 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-19 18:10:30,413 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-19 18:10:30,414 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 18:10:30,413 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-19 18:10:30,415 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-19 18:10:30,415 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-19 18:10:30,414 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 18:10:30,415 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33037,1689790219604' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-19 18:10:30,415 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44407,1689790219668' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-19 18:10:30,416 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-19 18:10:30,416 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-19 18:10:30,416 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40317,1689790219525' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-19 18:10:30,419 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 18:10:30,419 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:30,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:30,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 18:10:30,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 18:10:30,420 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:30,421 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 18:10:30,421 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 18:10:30,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 18:10:30,421 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 18:10:30,421 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 18:10:30,421 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 18:10:30,421 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 18:10:30,421 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 18:10:30,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 18:10:30,421 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 18:10:30,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 18:10:30,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:30,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:30,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:30,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 18:10:30,424 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33037,1689790219604' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-19 18:10:30,424 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2ecfba17[Count = 1] remaining members to acquire global barrier 2023-07-19 18:10:30,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:30,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 18:10:30,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 18:10:30,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 18:10:30,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 18:10:30,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 18:10:30,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:30,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:30,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:30,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 18:10:30,427 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40317,1689790219525' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-19 18:10:30,427 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2ecfba17[Count = 0] remaining members to acquire global barrier 2023-07-19 18:10:30,427 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-19 18:10:30,427 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 18:10:30,431 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 18:10:30,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 18:10:30,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 18:10:30,432 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-19 18:10:30,432 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-19 18:10:30,432 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,44407,1689790219668' in zk 2023-07-19 18:10:30,432 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 18:10:30,432 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 18:10:30,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 18:10:30,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 18:10:30,432 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-19 18:10:30,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 18:10:30,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 18:10:30,433 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-19 18:10:30,433 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 18:10:30,433 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 18:10:30,433 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 18:10:30,433 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 18:10:30,433 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689790228654.2d060c9134b0e7b667378bd04af8c2f8. 2023-07-19 18:10:30,433 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689790228654.a1439a0513f4736a3a6e29e97a527660. 2023-07-19 18:10:30,433 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689790228654.2d060c9134b0e7b667378bd04af8c2f8. started... 2023-07-19 18:10:30,433 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689790228654.a1439a0513f4736a3a6e29e97a527660. started... 2023-07-19 18:10:30,433 INFO [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a1439a0513f4736a3a6e29e97a527660 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-19 18:10:30,434 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:30,433 INFO [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 2d060c9134b0e7b667378bd04af8c2f8 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-19 18:10:30,436 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-19 18:10:30,436 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 18:10:30,436 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-19 18:10:30,437 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:30,437 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 18:10:30,462 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 18:10:30,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 18:10:30,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-19 18:10:30,464 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 18:10:30,570 INFO [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=333 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportWithTargetName/a1439a0513f4736a3a6e29e97a527660/.tmp/cf/783ec97af4f24cc58d005bb629ac0444 2023-07-19 18:10:30,574 INFO [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.93 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportWithTargetName/2d060c9134b0e7b667378bd04af8c2f8/.tmp/cf/8d34c44dfb1e432cb188a0d361b17a56 2023-07-19 18:10:30,621 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportWithTargetName/a1439a0513f4736a3a6e29e97a527660/.tmp/cf/783ec97af4f24cc58d005bb629ac0444 as hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportWithTargetName/a1439a0513f4736a3a6e29e97a527660/cf/783ec97af4f24cc58d005bb629ac0444 2023-07-19 18:10:30,621 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportWithTargetName/2d060c9134b0e7b667378bd04af8c2f8/.tmp/cf/8d34c44dfb1e432cb188a0d361b17a56 as hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportWithTargetName/2d060c9134b0e7b667378bd04af8c2f8/cf/8d34c44dfb1e432cb188a0d361b17a56 2023-07-19 18:10:30,630 INFO [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportWithTargetName/2d060c9134b0e7b667378bd04af8c2f8/cf/8d34c44dfb1e432cb188a0d361b17a56, entries=45, sequenceid=6, filesize=7.9 K 2023-07-19 18:10:30,630 INFO [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportWithTargetName/a1439a0513f4736a3a6e29e97a527660/cf/783ec97af4f24cc58d005bb629ac0444, entries=5, sequenceid=6, filesize=5.2 K 2023-07-19 18:10:30,635 INFO [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for a1439a0513f4736a3a6e29e97a527660 in 202ms, sequenceid=6, compaction requested=false 2023-07-19 18:10:30,635 INFO [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 2d060c9134b0e7b667378bd04af8c2f8 in 202ms, sequenceid=6, compaction requested=false 2023-07-19 18:10:30,635 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-19 18:10:30,635 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-19 18:10:30,638 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a1439a0513f4736a3a6e29e97a527660: 2023-07-19 18:10:30,638 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2d060c9134b0e7b667378bd04af8c2f8: 2023-07-19 18:10:30,638 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689790228654.a1439a0513f4736a3a6e29e97a527660.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-19 18:10:30,638 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 18:10:30,638 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689790228654.2d060c9134b0e7b667378bd04af8c2f8.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-19 18:10:30,639 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportWithTargetName/a1439a0513f4736a3a6e29e97a527660/cf/783ec97af4f24cc58d005bb629ac0444] hfiles 2023-07-19 18:10:30,639 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 18:10:30,639 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportWithTargetName/a1439a0513f4736a3a6e29e97a527660/cf/783ec97af4f24cc58d005bb629ac0444 for snapshot=snaptb0-testExportWithTargetName 2023-07-19 18:10:30,639 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportWithTargetName/2d060c9134b0e7b667378bd04af8c2f8/cf/8d34c44dfb1e432cb188a0d361b17a56] hfiles 2023-07-19 18:10:30,639 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportWithTargetName/2d060c9134b0e7b667378bd04af8c2f8/cf/8d34c44dfb1e432cb188a0d361b17a56 for snapshot=snaptb0-testExportWithTargetName 2023-07-19 18:10:30,664 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 18:10:30,665 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689790228654.2d060c9134b0e7b667378bd04af8c2f8. completed. 2023-07-19 18:10:30,665 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689790228654.2d060c9134b0e7b667378bd04af8c2f8. 2023-07-19 18:10:30,665 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 18:10:30,665 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 18:10:30,665 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:30,666 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-19 18:10:30,666 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,40317,1689790219525' in zk 2023-07-19 18:10:30,666 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689790228654.a1439a0513f4736a3a6e29e97a527660. completed. 2023-07-19 18:10:30,666 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689790228654.a1439a0513f4736a3a6e29e97a527660. 2023-07-19 18:10:30,666 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 18:10:30,666 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 18:10:30,666 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:30,666 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-19 18:10:30,666 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,33037,1689790219604' in zk 2023-07-19 18:10:30,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 18:10:30,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-19 18:10:30,667 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 18:10:30,669 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-19 18:10:30,669 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:30,669 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-19 18:10:30,669 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:30,670 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 18:10:30,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:30,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 18:10:30,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 18:10:30,669 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 18:10:30,670 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-19 18:10:30,671 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-19 18:10:30,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 18:10:30,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 18:10:30,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 18:10:30,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:30,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:30,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:30,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 18:10:30,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 18:10:30,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:30,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:30,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:30,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,33037,1689790219604': 2023-07-19 18:10:30,679 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33037,1689790219604' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-19 18:10:30,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:30,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 18:10:30,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 18:10:30,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 18:10:30,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 18:10:30,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 18:10:30,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:30,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:30,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:30,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 18:10:30,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 18:10:30,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:30,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:30,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:30,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,40317,1689790219525': 2023-07-19 18:10:30,683 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40317,1689790219525' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-19 18:10:30,683 INFO [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-19 18:10:30,683 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 18:10:30,683 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 18:10:30,683 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-19 18:10:30,683 INFO [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 18:10:30,685 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 18:10:30,685 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 18:10:30,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 18:10:30,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 18:10:30,685 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 18:10:30,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 18:10:30,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 18:10:30,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 18:10:30,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 18:10:30,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 18:10:30,685 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:10:30,685 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:10:30,685 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 18:10:30,686 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:10:30,686 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 18:10:30,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 18:10:30,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 18:10:30,686 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:10:30,686 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:30,686 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:10:30,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:10:30,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:10:30,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 18:10:30,686 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:10:30,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:10:30,686 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:30,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 18:10:30,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 18:10:30,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 18:10:30,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 18:10:30,687 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:30,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 18:10:30,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:30,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:30,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:30,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 18:10:30,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 18:10:30,689 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:30,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:30,690 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:30,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:30,690 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:30,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:30,700 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:10:30,700 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:10:30,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:10:30,700 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:10:30,701 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 18:10:30,700 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:30,701 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-19 18:10:30,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:10:30,702 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-19 18:10:30,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:10:30,701 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:10:30,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:10:30,700 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:10:30,701 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 18:10:30,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:10:30,702 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:10:30,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:10:30,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:10:30,702 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:30,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:10:30,702 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:30,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:10:30,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:10:30,702 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 18:10:30,703 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:30,703 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 18:10:30,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:10:30,703 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:30,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:10:30,703 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:30,703 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 18:10:30,703 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-19 18:10:30,703 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 18:10:30,745 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-19 18:10:30,788 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-19 18:10:30,788 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-19 18:10:30,788 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-19 18:10:30,788 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689790230360Consolidate snapshot: snaptb0-testExportWithTargetName at 1689790230702 (+342 ms)Loading Region manifests for snaptb0-testExportWithTargetName at 1689790230702Writing data manifest for snaptb0-testExportWithTargetName at 1689790230708 (+6 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689790230731 (+23 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689790230788 (+57 ms) 2023-07-19 18:10:30,790 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-19 18:10:30,793 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 429 msec 2023-07-19 18:10:30,967 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 18:10:30,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 18:10:30,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 18:10:30,974 INFO [Listener at jenkins-hbase4.apache.org/42301] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/export-test/export-1689790230974 2023-07-19 18:10:30,974 INFO [Listener at jenkins-hbase4.apache.org/42301] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:40881, tgtDir=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/export-test/export-1689790230974, rawTgtDir=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/export-test/export-1689790230974, srcFsUri=hdfs://localhost:40881, srcDir=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf 2023-07-19 18:10:31,018 DEBUG [Listener at jenkins-hbase4.apache.org/42301] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:40881, inputRoot=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf 2023-07-19 18:10:31,019 DEBUG [Listener at jenkins-hbase4.apache.org/42301] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-473292130_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/export-test/export-1689790230974, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/export-test/export-1689790230974/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-19 18:10:31,019 INFO [Listener at jenkins-hbase4.apache.org/42301] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:40881, inputRoot=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf, snapshotDir=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-19 18:10:31,040 INFO [Listener at jenkins-hbase4.apache.org/42301] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/export-test/export-1689790230974/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-19 18:10:31,138 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 18:10:31,138 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 18:10:31,139 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 18:10:31,140 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 18:10:31,140 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-19 18:10:31,141 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 18:10:31,141 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 18:10:31,237 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/hadoop-2981184138093622748.jar 2023-07-19 18:10:31,238 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 18:10:31,239 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 18:10:31,240 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 18:10:31,240 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 18:10:31,241 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 18:10:31,241 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 18:10:31,242 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 18:10:31,243 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 18:10:31,243 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 18:10:31,244 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 18:10:31,244 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 18:10:31,245 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 18:10:31,246 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 18:10:31,246 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 18:10:31,247 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 18:10:31,248 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 18:10:31,252 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 18:10:31,252 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 18:10:31,252 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 18:10:31,253 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 18:10:31,253 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 18:10:31,253 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 18:10:31,254 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 18:10:32,806 WARN [Listener at jenkins-hbase4.apache.org/42301] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 18:10:32,813 INFO [Listener at jenkins-hbase4.apache.org/42301] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-19 18:10:32,825 DEBUG [Listener at jenkins-hbase4.apache.org/42301] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-19 18:10:33,401 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 18:10:33,402 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 18:10:33,715 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689790227140_0001_000001 (auth:SIMPLE) 2023-07-19 18:10:34,683 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 18:10:39,108 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689790227140_0001_000001 (auth:SIMPLE) 2023-07-19 18:10:41,411 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689790227140_0001_000001 (auth:SIMPLE) 2023-07-19 18:10:45,118 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689790227140_0001_000001 (auth:SIMPLE) 2023-07-19 18:10:46,867 INFO [Listener at jenkins-hbase4.apache.org/42301] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 18:10:46,871 INFO [Listener at jenkins-hbase4.apache.org/42301] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 18:10:46,881 INFO [Listener at jenkins-hbase4.apache.org/42301] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-19 18:10:46,881 INFO [Listener at jenkins-hbase4.apache.org/42301] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 18:10:46,882 INFO [Listener at jenkins-hbase4.apache.org/42301] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 18:10:46,882 DEBUG [Listener at jenkins-hbase4.apache.org/42301] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2119224145_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-19 18:10:46,883 DEBUG [Listener at jenkins-hbase4.apache.org/42301] snapshot.TestExportSnapshot(367): hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-19 18:10:46,883 DEBUG [Listener at jenkins-hbase4.apache.org/42301] snapshot.TestExportSnapshot(367): hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-19 18:10:46,884 DEBUG [Listener at jenkins-hbase4.apache.org/42301] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2119224145_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/export-test/export-1689790230974/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/export-test/export-1689790230974/.hbase-snapshot/testExportWithTargetName 2023-07-19 18:10:46,884 DEBUG [Listener at jenkins-hbase4.apache.org/42301] snapshot.TestExportSnapshot(367): hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/export-test/export-1689790230974/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-19 18:10:46,884 DEBUG [Listener at jenkins-hbase4.apache.org/42301] snapshot.TestExportSnapshot(367): hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/export-test/export-1689790230974/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-19 18:10:46,898 INFO [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-19 18:10:46,903 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-19 18:10:46,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-19 18:10:46,920 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689790246919"}]},"ts":"1689790246919"} 2023-07-19 18:10:46,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-19 18:10:46,922 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-19 18:10:46,924 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-19 18:10:46,926 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a1439a0513f4736a3a6e29e97a527660, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=2d060c9134b0e7b667378bd04af8c2f8, UNASSIGN}] 2023-07-19 18:10:46,928 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a1439a0513f4736a3a6e29e97a527660, UNASSIGN 2023-07-19 18:10:46,928 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=2d060c9134b0e7b667378bd04af8c2f8, UNASSIGN 2023-07-19 18:10:46,929 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=a1439a0513f4736a3a6e29e97a527660, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:46,929 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=2d060c9134b0e7b667378bd04af8c2f8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:46,930 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689790228654.2d060c9134b0e7b667378bd04af8c2f8.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689790246929"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689790246929"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689790246929"}]},"ts":"1689790246929"} 2023-07-19 18:10:46,930 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689790228654.a1439a0513f4736a3a6e29e97a527660.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689790246929"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689790246929"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689790246929"}]},"ts":"1689790246929"} 2023-07-19 18:10:46,932 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE; CloseRegionProcedure 2d060c9134b0e7b667378bd04af8c2f8, server=jenkins-hbase4.apache.org,40317,1689790219525}] 2023-07-19 18:10:46,933 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; CloseRegionProcedure a1439a0513f4736a3a6e29e97a527660, server=jenkins-hbase4.apache.org,33037,1689790219604}] 2023-07-19 18:10:47,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-19 18:10:47,093 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 2d060c9134b0e7b667378bd04af8c2f8 2023-07-19 18:10:47,093 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a1439a0513f4736a3a6e29e97a527660 2023-07-19 18:10:47,093 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2d060c9134b0e7b667378bd04af8c2f8, disabling compactions & flushes 2023-07-19 18:10:47,093 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a1439a0513f4736a3a6e29e97a527660, disabling compactions & flushes 2023-07-19 18:10:47,093 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689790228654.2d060c9134b0e7b667378bd04af8c2f8. 2023-07-19 18:10:47,094 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689790228654.a1439a0513f4736a3a6e29e97a527660. 2023-07-19 18:10:47,094 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689790228654.2d060c9134b0e7b667378bd04af8c2f8. 2023-07-19 18:10:47,094 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689790228654.a1439a0513f4736a3a6e29e97a527660. 2023-07-19 18:10:47,094 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689790228654.2d060c9134b0e7b667378bd04af8c2f8. after waiting 0 ms 2023-07-19 18:10:47,094 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689790228654.a1439a0513f4736a3a6e29e97a527660. after waiting 0 ms 2023-07-19 18:10:47,094 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689790228654.2d060c9134b0e7b667378bd04af8c2f8. 2023-07-19 18:10:47,094 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689790228654.a1439a0513f4736a3a6e29e97a527660. 2023-07-19 18:10:47,111 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportWithTargetName/a1439a0513f4736a3a6e29e97a527660/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 18:10:47,111 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportWithTargetName/2d060c9134b0e7b667378bd04af8c2f8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 18:10:47,112 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 18:10:47,112 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 18:10:47,113 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689790228654.a1439a0513f4736a3a6e29e97a527660. 2023-07-19 18:10:47,113 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689790228654.2d060c9134b0e7b667378bd04af8c2f8. 2023-07-19 18:10:47,113 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a1439a0513f4736a3a6e29e97a527660: 2023-07-19 18:10:47,113 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2d060c9134b0e7b667378bd04af8c2f8: 2023-07-19 18:10:47,116 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 2d060c9134b0e7b667378bd04af8c2f8 2023-07-19 18:10:47,117 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=2d060c9134b0e7b667378bd04af8c2f8, regionState=CLOSED 2023-07-19 18:10:47,117 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689790228654.2d060c9134b0e7b667378bd04af8c2f8.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689790247117"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689790247117"}]},"ts":"1689790247117"} 2023-07-19 18:10:47,117 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a1439a0513f4736a3a6e29e97a527660 2023-07-19 18:10:47,118 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=a1439a0513f4736a3a6e29e97a527660, regionState=CLOSED 2023-07-19 18:10:47,118 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689790228654.a1439a0513f4736a3a6e29e97a527660.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689790247118"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689790247118"}]},"ts":"1689790247118"} 2023-07-19 18:10:47,122 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-07-19 18:10:47,122 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; CloseRegionProcedure 2d060c9134b0e7b667378bd04af8c2f8, server=jenkins-hbase4.apache.org,40317,1689790219525 in 187 msec 2023-07-19 18:10:47,123 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=22 2023-07-19 18:10:47,123 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=22, state=SUCCESS; CloseRegionProcedure a1439a0513f4736a3a6e29e97a527660, server=jenkins-hbase4.apache.org,33037,1689790219604 in 187 msec 2023-07-19 18:10:47,124 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=2d060c9134b0e7b667378bd04af8c2f8, UNASSIGN in 196 msec 2023-07-19 18:10:47,126 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=21 2023-07-19 18:10:47,126 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a1439a0513f4736a3a6e29e97a527660, UNASSIGN in 197 msec 2023-07-19 18:10:47,127 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689790247127"}]},"ts":"1689790247127"} 2023-07-19 18:10:47,129 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-19 18:10:47,130 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-19 18:10:47,133 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 224 msec 2023-07-19 18:10:47,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-19 18:10:47,224 INFO [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-19 18:10:47,229 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-19 18:10:47,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-19 18:10:47,239 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-19 18:10:47,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-19 18:10:47,241 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-19 18:10:47,244 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33037] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-19 18:10:47,247 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportWithTargetName/a1439a0513f4736a3a6e29e97a527660 2023-07-19 18:10:47,247 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportWithTargetName/2d060c9134b0e7b667378bd04af8c2f8 2023-07-19 18:10:47,248 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 18:10:47,248 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 18:10:47,248 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 18:10:47,248 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 18:10:47,249 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-19 18:10:47,249 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-19 18:10:47,249 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-19 18:10:47,249 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-19 18:10:47,251 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 18:10:47,251 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 18:10:47,251 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 18:10:47,251 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 18:10:47,251 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 18:10:47,251 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 18:10:47,251 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 18:10:47,251 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 18:10:47,251 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportWithTargetName/2d060c9134b0e7b667378bd04af8c2f8/cf, FileablePath, hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportWithTargetName/2d060c9134b0e7b667378bd04af8c2f8/recovered.edits] 2023-07-19 18:10:47,251 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportWithTargetName/a1439a0513f4736a3a6e29e97a527660/cf, FileablePath, hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportWithTargetName/a1439a0513f4736a3a6e29e97a527660/recovered.edits] 2023-07-19 18:10:47,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-19 18:10:47,261 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportWithTargetName/a1439a0513f4736a3a6e29e97a527660/cf/783ec97af4f24cc58d005bb629ac0444 to hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/archive/data/default/testtb-testExportWithTargetName/a1439a0513f4736a3a6e29e97a527660/cf/783ec97af4f24cc58d005bb629ac0444 2023-07-19 18:10:47,261 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportWithTargetName/2d060c9134b0e7b667378bd04af8c2f8/cf/8d34c44dfb1e432cb188a0d361b17a56 to hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/archive/data/default/testtb-testExportWithTargetName/2d060c9134b0e7b667378bd04af8c2f8/cf/8d34c44dfb1e432cb188a0d361b17a56 2023-07-19 18:10:47,266 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportWithTargetName/a1439a0513f4736a3a6e29e97a527660/recovered.edits/9.seqid to hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/archive/data/default/testtb-testExportWithTargetName/a1439a0513f4736a3a6e29e97a527660/recovered.edits/9.seqid 2023-07-19 18:10:47,266 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportWithTargetName/2d060c9134b0e7b667378bd04af8c2f8/recovered.edits/9.seqid to hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/archive/data/default/testtb-testExportWithTargetName/2d060c9134b0e7b667378bd04af8c2f8/recovered.edits/9.seqid 2023-07-19 18:10:47,267 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportWithTargetName/a1439a0513f4736a3a6e29e97a527660 2023-07-19 18:10:47,267 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportWithTargetName/2d060c9134b0e7b667378bd04af8c2f8 2023-07-19 18:10:47,267 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-19 18:10:47,270 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-19 18:10:47,291 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-19 18:10:47,294 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-19 18:10:47,296 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-19 18:10:47,296 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-19 18:10:47,296 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689790228654.a1439a0513f4736a3a6e29e97a527660.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689790247296"}]},"ts":"9223372036854775807"} 2023-07-19 18:10:47,296 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689790228654.2d060c9134b0e7b667378bd04af8c2f8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689790247296"}]},"ts":"9223372036854775807"} 2023-07-19 18:10:47,299 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-19 18:10:47,299 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => a1439a0513f4736a3a6e29e97a527660, NAME => 'testtb-testExportWithTargetName,,1689790228654.a1439a0513f4736a3a6e29e97a527660.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 2d060c9134b0e7b667378bd04af8c2f8, NAME => 'testtb-testExportWithTargetName,1,1689790228654.2d060c9134b0e7b667378bd04af8c2f8.', STARTKEY => '1', ENDKEY => ''}] 2023-07-19 18:10:47,299 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-19 18:10:47,299 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689790247299"}]},"ts":"9223372036854775807"} 2023-07-19 18:10:47,301 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-19 18:10:47,304 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-19 18:10:47,306 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 74 msec 2023-07-19 18:10:47,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-19 18:10:47,356 INFO [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-19 18:10:47,377 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-19 18:10:47,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-19 18:10:47,382 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-19 18:10:47,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-19 18:10:47,417 INFO [Listener at jenkins-hbase4.apache.org/42301] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=757 (was 707) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3af1d18e-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3af1d18e-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2119224145_17 at /127.0.0.1:48586 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/cluster_043905fa-2e83-af1f-d7d3-c2f0c5ac65c2/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/cluster_043905fa-2e83-af1f-d7d3-c2f0c5ac65c2/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/cluster_043905fa-2e83-af1f-d7d3-c2f0c5ac65c2/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1477432893) connection to jenkins-hbase4.apache.org/172.31.14.131:44249 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2119224145_17 at /127.0.0.1:37692 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1282 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3af1d18e-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2119224145_17 at /127.0.0.1:37866 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1477432893) connection to jenkins-hbase4.apache.org/172.31.14.131:33271 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1477432893) connection to jenkins-hbase4.apache.org/172.31.14.131:45785 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1534265182_1 at /127.0.0.1:37844 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3af1d18e-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/cluster_043905fa-2e83-af1f-d7d3-c2f0c5ac65c2/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/cluster_043905fa-2e83-af1f-d7d3-c2f0c5ac65c2/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/cluster_043905fa-2e83-af1f-d7d3-c2f0c5ac65c2/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=926 (was 915) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=432 (was 396) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 177) - ProcessCount LEAK? -, AvailableMemoryMB=3153 (was 4971) 2023-07-19 18:10:47,417 WARN [Listener at jenkins-hbase4.apache.org/42301] hbase.ResourceChecker(130): Thread=757 is superior to 500 2023-07-19 18:10:47,439 INFO [Listener at jenkins-hbase4.apache.org/42301] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=757, OpenFileDescriptor=926, MaxFileDescriptor=60000, SystemLoadAverage=432, ProcessCount=183, AvailableMemoryMB=3151 2023-07-19 18:10:47,439 WARN [Listener at jenkins-hbase4.apache.org/42301] hbase.ResourceChecker(130): Thread=757 is superior to 500 2023-07-19 18:10:47,441 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-19 18:10:47,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-19 18:10:47,447 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 18:10:47,448 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-19 18:10:47,449 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 18:10:47,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-19 18:10:47,455 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemState/7b826a753123f7e7002cdc8d54f6c0f7 2023-07-19 18:10:47,455 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemState/e8124f09fcc25aa4a1e3b78445cde42c 2023-07-19 18:10:47,457 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemState/e8124f09fcc25aa4a1e3b78445cde42c empty. 2023-07-19 18:10:47,458 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemState/7b826a753123f7e7002cdc8d54f6c0f7 empty. 2023-07-19 18:10:47,458 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemState/e8124f09fcc25aa4a1e3b78445cde42c 2023-07-19 18:10:47,459 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemState/7b826a753123f7e7002cdc8d54f6c0f7 2023-07-19 18:10:47,459 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-19 18:10:47,474 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-19 18:10:47,475 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7b826a753123f7e7002cdc8d54f6c0f7, NAME => 'testtb-testExportFileSystemState,,1689790247441.7b826a753123f7e7002cdc8d54f6c0f7.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp 2023-07-19 18:10:47,476 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => e8124f09fcc25aa4a1e3b78445cde42c, NAME => 'testtb-testExportFileSystemState,1,1689790247441.e8124f09fcc25aa4a1e3b78445cde42c.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp 2023-07-19 18:10:47,499 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689790247441.7b826a753123f7e7002cdc8d54f6c0f7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 18:10:47,500 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 7b826a753123f7e7002cdc8d54f6c0f7, disabling compactions & flushes 2023-07-19 18:10:47,500 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689790247441.7b826a753123f7e7002cdc8d54f6c0f7. 2023-07-19 18:10:47,500 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689790247441.7b826a753123f7e7002cdc8d54f6c0f7. 2023-07-19 18:10:47,500 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689790247441.7b826a753123f7e7002cdc8d54f6c0f7. after waiting 0 ms 2023-07-19 18:10:47,500 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689790247441.7b826a753123f7e7002cdc8d54f6c0f7. 2023-07-19 18:10:47,500 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689790247441.7b826a753123f7e7002cdc8d54f6c0f7. 2023-07-19 18:10:47,500 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 7b826a753123f7e7002cdc8d54f6c0f7: 2023-07-19 18:10:47,503 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689790247441.e8124f09fcc25aa4a1e3b78445cde42c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 18:10:47,504 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing e8124f09fcc25aa4a1e3b78445cde42c, disabling compactions & flushes 2023-07-19 18:10:47,504 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689790247441.e8124f09fcc25aa4a1e3b78445cde42c. 2023-07-19 18:10:47,504 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689790247441.e8124f09fcc25aa4a1e3b78445cde42c. 2023-07-19 18:10:47,504 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689790247441.e8124f09fcc25aa4a1e3b78445cde42c. after waiting 0 ms 2023-07-19 18:10:47,504 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689790247441.e8124f09fcc25aa4a1e3b78445cde42c. 2023-07-19 18:10:47,504 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689790247441.e8124f09fcc25aa4a1e3b78445cde42c. 2023-07-19 18:10:47,504 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for e8124f09fcc25aa4a1e3b78445cde42c: 2023-07-19 18:10:47,507 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 18:10:47,508 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689790247441.7b826a753123f7e7002cdc8d54f6c0f7.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689790247508"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689790247508"}]},"ts":"1689790247508"} 2023-07-19 18:10:47,508 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689790247441.e8124f09fcc25aa4a1e3b78445cde42c.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689790247508"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689790247508"}]},"ts":"1689790247508"} 2023-07-19 18:10:47,511 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 18:10:47,512 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 18:10:47,512 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689790247512"}]},"ts":"1689790247512"} 2023-07-19 18:10:47,514 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-19 18:10:47,518 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 18:10:47,520 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 18:10:47,520 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 18:10:47,520 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 18:10:47,520 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 18:10:47,520 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=7b826a753123f7e7002cdc8d54f6c0f7, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e8124f09fcc25aa4a1e3b78445cde42c, ASSIGN}] 2023-07-19 18:10:47,523 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e8124f09fcc25aa4a1e3b78445cde42c, ASSIGN 2023-07-19 18:10:47,523 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=7b826a753123f7e7002cdc8d54f6c0f7, ASSIGN 2023-07-19 18:10:47,524 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e8124f09fcc25aa4a1e3b78445cde42c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33037,1689790219604; forceNewPlan=false, retain=false 2023-07-19 18:10:47,524 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=7b826a753123f7e7002cdc8d54f6c0f7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44407,1689790219668; forceNewPlan=false, retain=false 2023-07-19 18:10:47,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-19 18:10:47,674 INFO [jenkins-hbase4:40453] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 18:10:47,677 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=e8124f09fcc25aa4a1e3b78445cde42c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:47,677 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=7b826a753123f7e7002cdc8d54f6c0f7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:47,678 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689790247441.e8124f09fcc25aa4a1e3b78445cde42c.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689790247677"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689790247677"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689790247677"}]},"ts":"1689790247677"} 2023-07-19 18:10:47,678 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689790247441.7b826a753123f7e7002cdc8d54f6c0f7.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689790247677"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689790247677"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689790247677"}]},"ts":"1689790247677"} 2023-07-19 18:10:47,680 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure e8124f09fcc25aa4a1e3b78445cde42c, server=jenkins-hbase4.apache.org,33037,1689790219604}] 2023-07-19 18:10:47,681 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 7b826a753123f7e7002cdc8d54f6c0f7, server=jenkins-hbase4.apache.org,44407,1689790219668}] 2023-07-19 18:10:47,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-19 18:10:47,841 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689790247441.e8124f09fcc25aa4a1e3b78445cde42c. 2023-07-19 18:10:47,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e8124f09fcc25aa4a1e3b78445cde42c, NAME => 'testtb-testExportFileSystemState,1,1689790247441.e8124f09fcc25aa4a1e3b78445cde42c.', STARTKEY => '1', ENDKEY => ''} 2023-07-19 18:10:47,842 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689790247441.e8124f09fcc25aa4a1e3b78445cde42c. service=AccessControlService 2023-07-19 18:10:47,842 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 18:10:47,842 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState e8124f09fcc25aa4a1e3b78445cde42c 2023-07-19 18:10:47,842 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689790247441.e8124f09fcc25aa4a1e3b78445cde42c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 18:10:47,842 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e8124f09fcc25aa4a1e3b78445cde42c 2023-07-19 18:10:47,842 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689790247441.7b826a753123f7e7002cdc8d54f6c0f7. 2023-07-19 18:10:47,842 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7b826a753123f7e7002cdc8d54f6c0f7, NAME => 'testtb-testExportFileSystemState,,1689790247441.7b826a753123f7e7002cdc8d54f6c0f7.', STARTKEY => '', ENDKEY => '1'} 2023-07-19 18:10:47,842 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e8124f09fcc25aa4a1e3b78445cde42c 2023-07-19 18:10:47,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689790247441.7b826a753123f7e7002cdc8d54f6c0f7. service=AccessControlService 2023-07-19 18:10:47,843 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 18:10:47,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 7b826a753123f7e7002cdc8d54f6c0f7 2023-07-19 18:10:47,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689790247441.7b826a753123f7e7002cdc8d54f6c0f7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 18:10:47,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7b826a753123f7e7002cdc8d54f6c0f7 2023-07-19 18:10:47,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7b826a753123f7e7002cdc8d54f6c0f7 2023-07-19 18:10:47,844 INFO [StoreOpener-e8124f09fcc25aa4a1e3b78445cde42c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e8124f09fcc25aa4a1e3b78445cde42c 2023-07-19 18:10:47,848 INFO [StoreOpener-7b826a753123f7e7002cdc8d54f6c0f7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7b826a753123f7e7002cdc8d54f6c0f7 2023-07-19 18:10:47,849 DEBUG [StoreOpener-e8124f09fcc25aa4a1e3b78445cde42c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemState/e8124f09fcc25aa4a1e3b78445cde42c/cf 2023-07-19 18:10:47,849 DEBUG [StoreOpener-e8124f09fcc25aa4a1e3b78445cde42c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemState/e8124f09fcc25aa4a1e3b78445cde42c/cf 2023-07-19 18:10:47,849 INFO [StoreOpener-e8124f09fcc25aa4a1e3b78445cde42c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e8124f09fcc25aa4a1e3b78445cde42c columnFamilyName cf 2023-07-19 18:10:47,849 DEBUG [StoreOpener-7b826a753123f7e7002cdc8d54f6c0f7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemState/7b826a753123f7e7002cdc8d54f6c0f7/cf 2023-07-19 18:10:47,849 DEBUG [StoreOpener-7b826a753123f7e7002cdc8d54f6c0f7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemState/7b826a753123f7e7002cdc8d54f6c0f7/cf 2023-07-19 18:10:47,850 INFO [StoreOpener-7b826a753123f7e7002cdc8d54f6c0f7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7b826a753123f7e7002cdc8d54f6c0f7 columnFamilyName cf 2023-07-19 18:10:47,850 INFO [StoreOpener-e8124f09fcc25aa4a1e3b78445cde42c-1] regionserver.HStore(310): Store=e8124f09fcc25aa4a1e3b78445cde42c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 18:10:47,852 INFO [StoreOpener-7b826a753123f7e7002cdc8d54f6c0f7-1] regionserver.HStore(310): Store=7b826a753123f7e7002cdc8d54f6c0f7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 18:10:47,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemState/e8124f09fcc25aa4a1e3b78445cde42c 2023-07-19 18:10:47,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemState/e8124f09fcc25aa4a1e3b78445cde42c 2023-07-19 18:10:47,854 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemState/7b826a753123f7e7002cdc8d54f6c0f7 2023-07-19 18:10:47,854 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemState/7b826a753123f7e7002cdc8d54f6c0f7 2023-07-19 18:10:47,858 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e8124f09fcc25aa4a1e3b78445cde42c 2023-07-19 18:10:47,858 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7b826a753123f7e7002cdc8d54f6c0f7 2023-07-19 18:10:47,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemState/e8124f09fcc25aa4a1e3b78445cde42c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 18:10:47,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemState/7b826a753123f7e7002cdc8d54f6c0f7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 18:10:47,861 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e8124f09fcc25aa4a1e3b78445cde42c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67886099, jitterRate=0.011581704020500183}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 18:10:47,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e8124f09fcc25aa4a1e3b78445cde42c: 2023-07-19 18:10:47,861 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7b826a753123f7e7002cdc8d54f6c0f7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74881908, jitterRate=0.11582738161087036}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 18:10:47,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7b826a753123f7e7002cdc8d54f6c0f7: 2023-07-19 18:10:47,863 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689790247441.e8124f09fcc25aa4a1e3b78445cde42c., pid=30, masterSystemTime=1689790247832 2023-07-19 18:10:47,863 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689790247441.7b826a753123f7e7002cdc8d54f6c0f7., pid=31, masterSystemTime=1689790247833 2023-07-19 18:10:47,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689790247441.e8124f09fcc25aa4a1e3b78445cde42c. 2023-07-19 18:10:47,865 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689790247441.e8124f09fcc25aa4a1e3b78445cde42c. 2023-07-19 18:10:47,866 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=e8124f09fcc25aa4a1e3b78445cde42c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:47,866 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689790247441.7b826a753123f7e7002cdc8d54f6c0f7. 2023-07-19 18:10:47,866 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689790247441.e8124f09fcc25aa4a1e3b78445cde42c.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689790247866"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689790247866"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689790247866"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689790247866"}]},"ts":"1689790247866"} 2023-07-19 18:10:47,866 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689790247441.7b826a753123f7e7002cdc8d54f6c0f7. 2023-07-19 18:10:47,867 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=7b826a753123f7e7002cdc8d54f6c0f7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:47,868 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689790247441.7b826a753123f7e7002cdc8d54f6c0f7.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689790247867"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689790247867"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689790247867"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689790247867"}]},"ts":"1689790247867"} 2023-07-19 18:10:47,872 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=29 2023-07-19 18:10:47,873 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure e8124f09fcc25aa4a1e3b78445cde42c, server=jenkins-hbase4.apache.org,33037,1689790219604 in 190 msec 2023-07-19 18:10:47,875 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=28 2023-07-19 18:10:47,876 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 7b826a753123f7e7002cdc8d54f6c0f7, server=jenkins-hbase4.apache.org,44407,1689790219668 in 190 msec 2023-07-19 18:10:47,878 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e8124f09fcc25aa4a1e3b78445cde42c, ASSIGN in 353 msec 2023-07-19 18:10:47,880 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-07-19 18:10:47,881 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=7b826a753123f7e7002cdc8d54f6c0f7, ASSIGN in 358 msec 2023-07-19 18:10:47,881 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 18:10:47,882 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689790247881"}]},"ts":"1689790247881"} 2023-07-19 18:10:47,883 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-19 18:10:47,959 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 18:10:47,960 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-19 18:10:47,962 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33037] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-19 18:10:48,051 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 18:10:48,052 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 18:10:48,051 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 18:10:48,051 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 18:10:48,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-19 18:10:48,128 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 18:10:48,128 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 18:10:48,128 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 18:10:48,128 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 18:10:48,130 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 685 msec 2023-07-19 18:10:48,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-19 18:10:48,564 INFO [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-19 18:10:48,564 DEBUG [Listener at jenkins-hbase4.apache.org/42301] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemState get assigned. Timeout = 60000ms 2023-07-19 18:10:48,564 INFO [Listener at jenkins-hbase4.apache.org/42301] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 18:10:48,568 INFO [Listener at jenkins-hbase4.apache.org/42301] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemState assigned to meta. Checking AM states. 2023-07-19 18:10:48,568 INFO [Listener at jenkins-hbase4.apache.org/42301] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 18:10:48,568 INFO [Listener at jenkins-hbase4.apache.org/42301] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemState assigned. 2023-07-19 18:10:48,572 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 18:10:48,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689790248572 (current time:1689790248572). 2023-07-19 18:10:48,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 18:10:48,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] zookeeper.ReadOnlyZKClient(139): Connect 0x0bc66063 to 127.0.0.1:51604 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 18:10:48,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6352083, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 18:10:48,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 18:10:48,628 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37394, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 18:10:48,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0bc66063 to 127.0.0.1:51604 2023-07-19 18:10:48,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 18:10:48,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] zookeeper.ReadOnlyZKClient(139): Connect 0x6596e447 to 127.0.0.1:51604 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 18:10:48,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5deb55ee, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 18:10:48,738 DEBUG [hconnection-0x727547e8-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 18:10:48,740 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37396, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 18:10:48,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6596e447 to 127.0.0.1:51604 2023-07-19 18:10:48,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 18:10:48,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-19 18:10:48,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 18:10:48,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 18:10:48,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-19 18:10:48,751 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-19 18:10:48,752 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689790848752 2023-07-19 18:10:48,752 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-19 18:10:48,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 18:10:48,754 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 18:10:48,754 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 18:10:48,755 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-19 18:10:48,755 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-19 18:10:48,757 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-19 18:10:48,758 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-19 18:10:48,760 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689790848760 2023-07-19 18:10:48,773 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-19 18:10:48,773 INFO [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-19 18:10:48,773 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 18:10:48,775 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-19 18:10:48,775 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-19 18:10:48,781 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 18:10:48,781 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 18:10:48,819 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:48,819 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:10:48,819 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:10:48,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:10:48,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:10:48,819 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:10:48,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:10:48,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:10:48,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:10:48,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:10:48,820 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:48,820 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:48,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 18:10:48,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 18:10:48,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 18:10:48,821 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:48,821 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 18:10:48,821 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 18:10:48,821 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 18:10:48,821 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 18:10:48,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-19 18:10:48,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-19 18:10:48,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 18:10:48,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 18:10:48,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-19 18:10:48,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 18:10:48,821 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-19 18:10:48,821 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-19 18:10:48,821 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-19 18:10:48,822 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-19 18:10:48,822 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-19 18:10:48,822 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-19 18:10:48,822 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-19 18:10:48,822 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-19 18:10:48,822 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-19 18:10:48,822 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 18:10:48,822 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 18:10:48,824 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-19 18:10:48,825 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-19 18:10:48,822 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 18:10:48,825 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44407,1689790219668' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-19 18:10:48,825 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-19 18:10:48,826 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-19 18:10:48,826 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-19 18:10:48,826 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-19 18:10:48,826 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33037,1689790219604' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-19 18:10:48,826 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40317,1689790219525' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-19 18:10:48,854 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 18:10:48,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 18:10:48,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 18:10:48,856 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 18:10:48,888 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:48,888 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 18:10:48,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:48,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 18:10:48,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 18:10:49,056 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 18:10:49,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 18:10:49,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 18:10:49,057 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 18:10:49,119 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:49,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 18:10:49,119 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 18:10:49,120 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 18:10:49,119 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 18:10:49,119 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 18:10:49,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 18:10:49,120 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 18:10:49,120 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 18:10:49,120 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 18:10:49,120 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 18:10:49,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 18:10:49,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:49,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:49,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:49,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 18:10:49,122 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44407,1689790219668' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-19 18:10:49,122 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1852104b[Count = 1] remaining members to acquire global barrier 2023-07-19 18:10:49,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:49,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 18:10:49,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 18:10:49,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 18:10:49,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 18:10:49,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 18:10:49,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:49,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:49,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:49,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 18:10:49,125 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33037,1689790219604' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-19 18:10:49,125 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1852104b[Count = 0] remaining members to acquire global barrier 2023-07-19 18:10:49,125 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-19 18:10:49,125 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 18:10:49,204 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 18:10:49,204 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 18:10:49,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 18:10:49,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 18:10:49,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 18:10:49,204 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 18:10:49,204 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-19 18:10:49,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 18:10:49,204 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:49,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 18:10:49,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 18:10:49,205 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-19 18:10:49,205 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689790247441.e8124f09fcc25aa4a1e3b78445cde42c. 2023-07-19 18:10:49,205 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-19 18:10:49,205 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-19 18:10:49,205 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 18:10:49,205 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 18:10:49,205 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:49,205 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 18:10:49,205 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40317,1689790219525' in zk 2023-07-19 18:10:49,205 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689790247441.e8124f09fcc25aa4a1e3b78445cde42c. started... 2023-07-19 18:10:49,205 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 18:10:49,205 DEBUG [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689790247441.7b826a753123f7e7002cdc8d54f6c0f7. 2023-07-19 18:10:49,205 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 18:10:49,205 DEBUG [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689790247441.7b826a753123f7e7002cdc8d54f6c0f7. started... 2023-07-19 18:10:49,207 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e8124f09fcc25aa4a1e3b78445cde42c: 2023-07-19 18:10:49,209 DEBUG [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7b826a753123f7e7002cdc8d54f6c0f7: 2023-07-19 18:10:49,209 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689790247441.e8124f09fcc25aa4a1e3b78445cde42c.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-19 18:10:49,209 DEBUG [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689790247441.7b826a753123f7e7002cdc8d54f6c0f7.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-19 18:10:49,209 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 18:10:49,209 DEBUG [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 18:10:49,209 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 18:10:49,209 DEBUG [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 18:10:49,223 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689790247441.e8124f09fcc25aa4a1e3b78445cde42c. completed. 2023-07-19 18:10:49,223 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689790247441.e8124f09fcc25aa4a1e3b78445cde42c. 2023-07-19 18:10:49,223 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 18:10:49,223 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 18:10:49,223 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:49,227 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-19 18:10:49,227 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33037,1689790219604' in zk 2023-07-19 18:10:49,230 DEBUG [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689790247441.7b826a753123f7e7002cdc8d54f6c0f7. completed. 2023-07-19 18:10:49,230 DEBUG [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689790247441.7b826a753123f7e7002cdc8d54f6c0f7. 2023-07-19 18:10:49,230 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 18:10:49,230 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 18:10:49,230 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:49,230 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-19 18:10:49,230 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44407,1689790219668' in zk 2023-07-19 18:10:49,265 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-19 18:10:49,266 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 18:10:49,266 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-19 18:10:49,312 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-19 18:10:49,312 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:49,312 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 18:10:49,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:49,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 18:10:49,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 18:10:49,312 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-19 18:10:49,312 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-19 18:10:49,312 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:49,314 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 18:10:49,314 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-19 18:10:49,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 18:10:49,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 18:10:49,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 18:10:49,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:49,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:49,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:49,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 18:10:49,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 18:10:49,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:49,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:49,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:49,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,33037,1689790219604': 2023-07-19 18:10:49,320 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33037,1689790219604' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-19 18:10:49,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:49,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 18:10:49,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 18:10:49,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 18:10:49,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 18:10:49,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 18:10:49,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:49,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:49,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:49,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 18:10:49,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 18:10:49,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:49,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:49,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:49,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,44407,1689790219668': 2023-07-19 18:10:49,325 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44407,1689790219668' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-19 18:10:49,325 INFO [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-19 18:10:49,325 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 18:10:49,325 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 18:10:49,325 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-19 18:10:49,325 INFO [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 18:10:49,358 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 18:10:49,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 18:10:49,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 18:10:49,360 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-19 18:10:49,366 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 18:10:49,366 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 18:10:49,366 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 18:10:49,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 18:10:49,366 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:10:49,366 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 18:10:49,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 18:10:49,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 18:10:49,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 18:10:49,366 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:10:49,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 18:10:49,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 18:10:49,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 18:10:49,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 18:10:49,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 18:10:49,366 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:10:49,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:10:49,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:10:49,368 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:49,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:10:49,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:10:49,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 18:10:49,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 18:10:49,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:10:49,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:10:49,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 18:10:49,368 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:49,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 18:10:49,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 18:10:49,369 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:49,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 18:10:49,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 18:10:49,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:49,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:49,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:49,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 18:10:49,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 18:10:49,376 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:49,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:49,376 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:49,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:49,377 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:49,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:49,389 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:49,389 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:10:49,389 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 18:10:49,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:10:49,389 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 18:10:49,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:10:49,389 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-19 18:10:49,391 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-19 18:10:49,391 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:10:49,391 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:10:49,389 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:49,391 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:49,391 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 18:10:49,391 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:49,391 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 18:10:49,391 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:49,391 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:49,391 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 18:10:49,391 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 18:10:49,392 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:10:49,392 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:10:49,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:10:49,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:10:49,392 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-19 18:10:49,389 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:10:49,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:10:49,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:10:49,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:10:49,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:10:49,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:10:49,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:10:49,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:10:49,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:10:49,439 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-19 18:10:49,474 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-19 18:10:49,475 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-19 18:10:49,475 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-19 18:10:49,475 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689790248752Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689790249391 (+639 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689790249391Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689790249402 (+11 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689790249429 (+27 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689790249474 (+45 ms) 2023-07-19 18:10:49,478 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-19 18:10:49,480 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 725 msec 2023-07-19 18:10:49,860 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 18:10:49,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 18:10:49,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 18:10:49,872 DEBUG [htable-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 18:10:49,881 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55184, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 18:10:49,882 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33037] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689790247441.e8124f09fcc25aa4a1e3b78445cde42c. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 18:10:49,883 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44407] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689790247441.7b826a753123f7e7002cdc8d54f6c0f7. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 18:10:49,893 DEBUG [Listener at jenkins-hbase4.apache.org/42301] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-19 18:10:49,893 DEBUG [Listener at jenkins-hbase4.apache.org/42301] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689790247441.7b826a753123f7e7002cdc8d54f6c0f7. 2023-07-19 18:10:49,895 INFO [Listener at jenkins-hbase4.apache.org/42301] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 18:10:49,921 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 18:10:49,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689790249921 (current time:1689790249921). 2023-07-19 18:10:49,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 18:10:49,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] zookeeper.ReadOnlyZKClient(139): Connect 0x4829ca57 to 127.0.0.1:51604 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 18:10:49,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@793376ef, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 18:10:49,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 18:10:49,934 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37398, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 18:10:49,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4829ca57 to 127.0.0.1:51604 2023-07-19 18:10:49,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 18:10:49,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] zookeeper.ReadOnlyZKClient(139): Connect 0x65f5758b to 127.0.0.1:51604 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 18:10:49,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@16ee690, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 18:10:49,954 DEBUG [hconnection-0x504ffd2a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 18:10:49,958 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37406, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 18:10:49,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x65f5758b to 127.0.0.1:51604 2023-07-19 18:10:49,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 18:10:49,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-19 18:10:49,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 18:10:49,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 18:10:49,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-19 18:10:49,982 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-19 18:10:49,983 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689790849983 2023-07-19 18:10:49,983 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-19 18:10:49,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 18:10:49,986 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 18:10:49,986 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 18:10:49,990 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-19 18:10:49,990 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-19 18:10:49,994 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 12 msec 2023-07-19 18:10:49,996 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-19 18:10:49,998 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689790849998 2023-07-19 18:10:50,020 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-19 18:10:50,020 INFO [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-19 18:10:50,020 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 18:10:50,022 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-19 18:10:50,022 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-19 18:10:50,022 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 18:10:50,022 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 18:10:50,024 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:10:50,024 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:10:50,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:10:50,024 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:10:50,024 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:50,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:10:50,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:10:50,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:10:50,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:10:50,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:10:50,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 18:10:50,025 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:50,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 18:10:50,025 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:50,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 18:10:50,025 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 18:10:50,025 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 18:10:50,025 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:50,025 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 18:10:50,025 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 18:10:50,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-19 18:10:50,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 18:10:50,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-19 18:10:50,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 18:10:50,026 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-19 18:10:50,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-19 18:10:50,026 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-19 18:10:50,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 18:10:50,026 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-19 18:10:50,026 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-19 18:10:50,026 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-19 18:10:50,026 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-19 18:10:50,026 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-19 18:10:50,026 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 18:10:50,026 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 18:10:50,028 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-19 18:10:50,028 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-19 18:10:50,028 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-19 18:10:50,028 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-19 18:10:50,028 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-19 18:10:50,028 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 18:10:50,028 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40317,1689790219525' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-19 18:10:50,029 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-19 18:10:50,029 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-19 18:10:50,028 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-19 18:10:50,029 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44407,1689790219668' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-19 18:10:50,029 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33037,1689790219604' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-19 18:10:50,032 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 18:10:50,034 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:50,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:50,034 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 18:10:50,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 18:10:50,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 18:10:50,035 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 18:10:50,035 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 18:10:50,035 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 18:10:50,035 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 18:10:50,035 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 18:10:50,035 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:50,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 18:10:50,035 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 18:10:50,035 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 18:10:50,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 18:10:50,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 18:10:50,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:50,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:50,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:50,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 18:10:50,037 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44407,1689790219668' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-19 18:10:50,037 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@343383c8[Count = 1] remaining members to acquire global barrier 2023-07-19 18:10:50,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:50,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 18:10:50,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 18:10:50,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 18:10:50,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 18:10:50,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 18:10:50,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:50,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:50,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:50,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 18:10:50,039 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33037,1689790219604' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-19 18:10:50,039 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@343383c8[Count = 0] remaining members to acquire global barrier 2023-07-19 18:10:50,039 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-19 18:10:50,039 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 18:10:50,041 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 18:10:50,041 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 18:10:50,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 18:10:50,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 18:10:50,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 18:10:50,041 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 18:10:50,043 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-19 18:10:50,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 18:10:50,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 18:10:50,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 18:10:50,043 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-19 18:10:50,043 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 18:10:50,043 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 18:10:50,043 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-19 18:10:50,043 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 18:10:50,043 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 18:10:50,043 DEBUG [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689790247441.7b826a753123f7e7002cdc8d54f6c0f7. 2023-07-19 18:10:50,043 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-19 18:10:50,043 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:50,043 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689790247441.e8124f09fcc25aa4a1e3b78445cde42c. 2023-07-19 18:10:50,043 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40317,1689790219525' in zk 2023-07-19 18:10:50,043 DEBUG [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689790247441.7b826a753123f7e7002cdc8d54f6c0f7. started... 2023-07-19 18:10:50,044 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689790247441.e8124f09fcc25aa4a1e3b78445cde42c. started... 2023-07-19 18:10:50,044 INFO [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 7b826a753123f7e7002cdc8d54f6c0f7 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-19 18:10:50,044 INFO [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e8124f09fcc25aa4a1e3b78445cde42c 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-19 18:10:50,044 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:50,044 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 18:10:50,050 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-19 18:10:50,050 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 18:10:50,050 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-19 18:10:50,075 INFO [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemState/e8124f09fcc25aa4a1e3b78445cde42c/.tmp/cf/dd7f2fa19d4940fc8d4bbb904ceaa736 2023-07-19 18:10:50,076 INFO [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemState/7b826a753123f7e7002cdc8d54f6c0f7/.tmp/cf/2f5feb1554bb4881ad5cd246c5a354fb 2023-07-19 18:10:50,087 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 18:10:50,087 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemState/e8124f09fcc25aa4a1e3b78445cde42c/.tmp/cf/dd7f2fa19d4940fc8d4bbb904ceaa736 as hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemState/e8124f09fcc25aa4a1e3b78445cde42c/cf/dd7f2fa19d4940fc8d4bbb904ceaa736 2023-07-19 18:10:50,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 18:10:50,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 18:10:50,089 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 18:10:50,091 DEBUG [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemState/7b826a753123f7e7002cdc8d54f6c0f7/.tmp/cf/2f5feb1554bb4881ad5cd246c5a354fb as hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemState/7b826a753123f7e7002cdc8d54f6c0f7/cf/2f5feb1554bb4881ad5cd246c5a354fb 2023-07-19 18:10:50,097 INFO [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemState/e8124f09fcc25aa4a1e3b78445cde42c/cf/dd7f2fa19d4940fc8d4bbb904ceaa736, entries=47, sequenceid=6, filesize=8.0 K 2023-07-19 18:10:50,098 INFO [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for e8124f09fcc25aa4a1e3b78445cde42c in 54ms, sequenceid=6, compaction requested=false 2023-07-19 18:10:50,099 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-19 18:10:50,099 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e8124f09fcc25aa4a1e3b78445cde42c: 2023-07-19 18:10:50,100 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689790247441.e8124f09fcc25aa4a1e3b78445cde42c.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-19 18:10:50,100 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 18:10:50,100 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemState/e8124f09fcc25aa4a1e3b78445cde42c/cf/dd7f2fa19d4940fc8d4bbb904ceaa736] hfiles 2023-07-19 18:10:50,100 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemState/e8124f09fcc25aa4a1e3b78445cde42c/cf/dd7f2fa19d4940fc8d4bbb904ceaa736 for snapshot=snaptb0-testExportFileSystemState 2023-07-19 18:10:50,101 INFO [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemState/7b826a753123f7e7002cdc8d54f6c0f7/cf/2f5feb1554bb4881ad5cd246c5a354fb, entries=3, sequenceid=6, filesize=5.0 K 2023-07-19 18:10:50,103 INFO [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 7b826a753123f7e7002cdc8d54f6c0f7 in 59ms, sequenceid=6, compaction requested=false 2023-07-19 18:10:50,105 DEBUG [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7b826a753123f7e7002cdc8d54f6c0f7: 2023-07-19 18:10:50,105 DEBUG [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689790247441.7b826a753123f7e7002cdc8d54f6c0f7.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-19 18:10:50,105 DEBUG [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 18:10:50,105 DEBUG [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemState/7b826a753123f7e7002cdc8d54f6c0f7/cf/2f5feb1554bb4881ad5cd246c5a354fb] hfiles 2023-07-19 18:10:50,105 DEBUG [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemState/7b826a753123f7e7002cdc8d54f6c0f7/cf/2f5feb1554bb4881ad5cd246c5a354fb for snapshot=snaptb0-testExportFileSystemState 2023-07-19 18:10:50,126 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689790247441.e8124f09fcc25aa4a1e3b78445cde42c. completed. 2023-07-19 18:10:50,126 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689790247441.e8124f09fcc25aa4a1e3b78445cde42c. 2023-07-19 18:10:50,126 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 18:10:50,126 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 18:10:50,126 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:50,126 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-19 18:10:50,126 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33037,1689790219604' in zk 2023-07-19 18:10:50,138 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:50,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:50,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 18:10:50,139 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-19 18:10:50,139 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 18:10:50,139 DEBUG [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689790247441.7b826a753123f7e7002cdc8d54f6c0f7. completed. 2023-07-19 18:10:50,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 18:10:50,141 DEBUG [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689790247441.7b826a753123f7e7002cdc8d54f6c0f7. 2023-07-19 18:10:50,139 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-19 18:10:50,141 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 18:10:50,141 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 18:10:50,141 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:50,141 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-19 18:10:50,141 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44407,1689790219668' in zk 2023-07-19 18:10:50,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 18:10:50,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 18:10:50,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 18:10:50,145 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:50,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:50,145 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-19 18:10:50,145 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 18:10:50,145 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-19 18:10:50,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:50,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:50,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 18:10:50,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 18:10:50,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:50,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:50,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:50,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,33037,1689790219604': 2023-07-19 18:10:50,151 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33037,1689790219604' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-19 18:10:50,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:50,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 18:10:50,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 18:10:50,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 18:10:50,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 18:10:50,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 18:10:50,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:50,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:50,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:50,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 18:10:50,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 18:10:50,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:50,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:50,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:50,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,44407,1689790219668': 2023-07-19 18:10:50,159 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44407,1689790219668' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-19 18:10:50,159 INFO [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-19 18:10:50,159 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 18:10:50,159 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 18:10:50,159 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-19 18:10:50,159 INFO [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 18:10:50,163 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 18:10:50,163 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 18:10:50,163 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 18:10:50,163 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 18:10:50,163 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 18:10:50,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 18:10:50,163 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 18:10:50,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 18:10:50,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 18:10:50,163 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:10:50,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 18:10:50,163 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 18:10:50,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 18:10:50,163 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:10:50,163 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:10:50,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 18:10:50,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 18:10:50,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:10:50,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:10:50,164 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:50,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:10:50,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:10:50,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 18:10:50,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:10:50,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:10:50,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 18:10:50,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 18:10:50,165 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:50,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 18:10:50,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 18:10:50,165 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:50,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 18:10:50,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:50,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:50,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:50,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 18:10:50,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 18:10:50,168 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:50,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:50,168 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:50,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:50,169 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:50,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:50,173 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:50,173 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 18:10:50,173 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:50,174 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:10:50,174 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:50,174 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 18:10:50,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:10:50,174 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:10:50,174 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 18:10:50,174 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:10:50,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:10:50,174 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:10:50,174 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:10:50,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:10:50,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:10:50,176 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 18:10:50,176 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:10:50,176 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:10:50,176 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 18:10:50,177 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 18:10:50,176 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:10:50,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:10:50,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:10:50,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:10:50,174 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-19 18:10:50,177 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-19 18:10:50,174 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:10:50,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:10:50,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:10:50,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:10:50,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:10:50,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:10:50,179 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-19 18:10:50,245 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-19 18:10:50,291 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 18:10:50,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 18:10:50,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 18:10:50,293 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 18:10:50,307 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-19 18:10:50,307 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-19 18:10:50,308 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-19 18:10:50,308 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689790249984Consolidate snapshot: snaptb0-testExportFileSystemState at 1689790250177 (+193 ms)Loading Region manifests for snaptb0-testExportFileSystemState at 1689790250177Writing data manifest for snaptb0-testExportFileSystemState at 1689790250184 (+7 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689790250224 (+40 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689790250307 (+83 ms) 2023-07-19 18:10:50,314 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-19 18:10:50,317 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 329 msec 2023-07-19 18:10:50,593 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 18:10:50,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 18:10:50,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 18:10:50,600 INFO [Listener at jenkins-hbase4.apache.org/42301] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/export-test/export-1689790250600 2023-07-19 18:10:50,600 INFO [Listener at jenkins-hbase4.apache.org/42301] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:40881, tgtDir=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/export-test/export-1689790250600, rawTgtDir=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/export-test/export-1689790250600, srcFsUri=hdfs://localhost:40881, srcDir=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf 2023-07-19 18:10:50,629 DEBUG [Listener at jenkins-hbase4.apache.org/42301] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:40881, inputRoot=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf 2023-07-19 18:10:50,630 DEBUG [Listener at jenkins-hbase4.apache.org/42301] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_696124843_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/export-test/export-1689790250600, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/export-test/export-1689790250600/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-19 18:10:50,630 INFO [Listener at jenkins-hbase4.apache.org/42301] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:40881, inputRoot=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf, snapshotDir=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-19 18:10:50,652 INFO [Listener at jenkins-hbase4.apache.org/42301] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/export-test/export-1689790250600/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-19 18:10:50,697 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 18:10:50,697 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 18:10:50,698 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 18:10:50,698 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 18:10:50,698 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-19 18:10:50,699 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 18:10:50,699 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 18:10:50,786 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/hadoop-8759007155674974400.jar 2023-07-19 18:10:50,787 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 18:10:50,787 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 18:10:50,788 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 18:10:50,788 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 18:10:50,789 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 18:10:50,790 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 18:10:50,790 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 18:10:50,791 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 18:10:50,792 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 18:10:50,792 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 18:10:50,793 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 18:10:50,793 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 18:10:50,794 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 18:10:50,794 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 18:10:50,795 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 18:10:50,795 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 18:10:50,796 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 18:10:50,797 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 18:10:50,797 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 18:10:50,798 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 18:10:50,798 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 18:10:50,799 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 18:10:50,799 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 18:10:51,409 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689790227140_0001_000001 (auth:SIMPLE) 2023-07-19 18:10:51,519 WARN [Listener at jenkins-hbase4.apache.org/42301] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 18:10:51,522 INFO [Listener at jenkins-hbase4.apache.org/42301] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-19 18:10:51,525 DEBUG [Listener at jenkins-hbase4.apache.org/42301] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-19 18:10:51,621 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 18:10:51,621 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 18:10:52,028 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689790227140_0002_000001 (auth:SIMPLE) 2023-07-19 18:10:52,724 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 18:10:56,807 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689790227140_0002_000001 (auth:SIMPLE) 2023-07-19 18:10:59,044 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689790227140_0002_000001 (auth:SIMPLE) 2023-07-19 18:11:01,813 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689790227140_0002_000001 (auth:SIMPLE) 2023-07-19 18:11:03,777 INFO [Listener at jenkins-hbase4.apache.org/42301] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 18:11:03,778 INFO [Listener at jenkins-hbase4.apache.org/42301] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 18:11:03,787 INFO [Listener at jenkins-hbase4.apache.org/42301] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-19 18:11:03,787 INFO [Listener at jenkins-hbase4.apache.org/42301] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 18:11:03,788 INFO [Listener at jenkins-hbase4.apache.org/42301] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 18:11:03,788 DEBUG [Listener at jenkins-hbase4.apache.org/42301] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2119224145_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-19 18:11:03,788 DEBUG [Listener at jenkins-hbase4.apache.org/42301] snapshot.TestExportSnapshot(367): hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-19 18:11:03,788 DEBUG [Listener at jenkins-hbase4.apache.org/42301] snapshot.TestExportSnapshot(367): hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-19 18:11:03,788 DEBUG [Listener at jenkins-hbase4.apache.org/42301] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2119224145_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/export-test/export-1689790250600/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/export-test/export-1689790250600/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-19 18:11:03,789 DEBUG [Listener at jenkins-hbase4.apache.org/42301] snapshot.TestExportSnapshot(367): hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/export-test/export-1689790250600/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-19 18:11:03,789 DEBUG [Listener at jenkins-hbase4.apache.org/42301] snapshot.TestExportSnapshot(367): hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/export-test/export-1689790250600/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-19 18:11:03,796 INFO [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-19 18:11:03,796 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-19 18:11:03,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-19 18:11:03,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-19 18:11:03,802 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689790263802"}]},"ts":"1689790263802"} 2023-07-19 18:11:03,804 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-19 18:11:03,806 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-19 18:11:03,807 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=7b826a753123f7e7002cdc8d54f6c0f7, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e8124f09fcc25aa4a1e3b78445cde42c, UNASSIGN}] 2023-07-19 18:11:03,809 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e8124f09fcc25aa4a1e3b78445cde42c, UNASSIGN 2023-07-19 18:11:03,809 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=7b826a753123f7e7002cdc8d54f6c0f7, UNASSIGN 2023-07-19 18:11:03,810 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=e8124f09fcc25aa4a1e3b78445cde42c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:03,810 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=7b826a753123f7e7002cdc8d54f6c0f7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:03,810 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689790247441.e8124f09fcc25aa4a1e3b78445cde42c.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689790263810"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689790263810"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689790263810"}]},"ts":"1689790263810"} 2023-07-19 18:11:03,810 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689790247441.7b826a753123f7e7002cdc8d54f6c0f7.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689790263810"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689790263810"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689790263810"}]},"ts":"1689790263810"} 2023-07-19 18:11:03,812 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure e8124f09fcc25aa4a1e3b78445cde42c, server=jenkins-hbase4.apache.org,33037,1689790219604}] 2023-07-19 18:11:03,813 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure 7b826a753123f7e7002cdc8d54f6c0f7, server=jenkins-hbase4.apache.org,44407,1689790219668}] 2023-07-19 18:11:03,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-19 18:11:03,964 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e8124f09fcc25aa4a1e3b78445cde42c 2023-07-19 18:11:03,965 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e8124f09fcc25aa4a1e3b78445cde42c, disabling compactions & flushes 2023-07-19 18:11:03,965 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 7b826a753123f7e7002cdc8d54f6c0f7 2023-07-19 18:11:03,965 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689790247441.e8124f09fcc25aa4a1e3b78445cde42c. 2023-07-19 18:11:03,965 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689790247441.e8124f09fcc25aa4a1e3b78445cde42c. 2023-07-19 18:11:03,965 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689790247441.e8124f09fcc25aa4a1e3b78445cde42c. after waiting 0 ms 2023-07-19 18:11:03,965 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7b826a753123f7e7002cdc8d54f6c0f7, disabling compactions & flushes 2023-07-19 18:11:03,965 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689790247441.e8124f09fcc25aa4a1e3b78445cde42c. 2023-07-19 18:11:03,965 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689790247441.7b826a753123f7e7002cdc8d54f6c0f7. 2023-07-19 18:11:03,965 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689790247441.7b826a753123f7e7002cdc8d54f6c0f7. 2023-07-19 18:11:03,965 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689790247441.7b826a753123f7e7002cdc8d54f6c0f7. after waiting 0 ms 2023-07-19 18:11:03,965 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689790247441.7b826a753123f7e7002cdc8d54f6c0f7. 2023-07-19 18:11:03,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemState/7b826a753123f7e7002cdc8d54f6c0f7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 18:11:03,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemState/e8124f09fcc25aa4a1e3b78445cde42c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 18:11:03,980 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 18:11:03,981 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 18:11:03,982 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689790247441.7b826a753123f7e7002cdc8d54f6c0f7. 2023-07-19 18:11:03,982 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689790247441.e8124f09fcc25aa4a1e3b78445cde42c. 2023-07-19 18:11:03,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7b826a753123f7e7002cdc8d54f6c0f7: 2023-07-19 18:11:03,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e8124f09fcc25aa4a1e3b78445cde42c: 2023-07-19 18:11:03,984 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 7b826a753123f7e7002cdc8d54f6c0f7 2023-07-19 18:11:03,984 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=7b826a753123f7e7002cdc8d54f6c0f7, regionState=CLOSED 2023-07-19 18:11:03,984 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689790247441.7b826a753123f7e7002cdc8d54f6c0f7.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689790263984"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689790263984"}]},"ts":"1689790263984"} 2023-07-19 18:11:03,985 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e8124f09fcc25aa4a1e3b78445cde42c 2023-07-19 18:11:03,985 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=e8124f09fcc25aa4a1e3b78445cde42c, regionState=CLOSED 2023-07-19 18:11:03,985 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689790247441.e8124f09fcc25aa4a1e3b78445cde42c.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689790263985"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689790263985"}]},"ts":"1689790263985"} 2023-07-19 18:11:03,991 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=37 2023-07-19 18:11:03,992 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure 7b826a753123f7e7002cdc8d54f6c0f7, server=jenkins-hbase4.apache.org,44407,1689790219668 in 173 msec 2023-07-19 18:11:03,992 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=38 2023-07-19 18:11:03,992 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure e8124f09fcc25aa4a1e3b78445cde42c, server=jenkins-hbase4.apache.org,33037,1689790219604 in 175 msec 2023-07-19 18:11:03,993 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=7b826a753123f7e7002cdc8d54f6c0f7, UNASSIGN in 185 msec 2023-07-19 18:11:03,994 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=36 2023-07-19 18:11:03,994 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e8124f09fcc25aa4a1e3b78445cde42c, UNASSIGN in 185 msec 2023-07-19 18:11:03,995 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689790263995"}]},"ts":"1689790263995"} 2023-07-19 18:11:03,996 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-19 18:11:03,998 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-19 18:11:04,000 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 203 msec 2023-07-19 18:11:04,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-19 18:11:04,104 INFO [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-19 18:11:04,105 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-19 18:11:04,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-19 18:11:04,108 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-19 18:11:04,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-19 18:11:04,109 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-19 18:11:04,111 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33037] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-19 18:11:04,114 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 18:11:04,114 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 18:11:04,114 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 18:11:04,114 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 18:11:04,114 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemState/7b826a753123f7e7002cdc8d54f6c0f7 2023-07-19 18:11:04,115 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemState/e8124f09fcc25aa4a1e3b78445cde42c 2023-07-19 18:11:04,115 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-19 18:11:04,115 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-19 18:11:04,115 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-19 18:11:04,115 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-19 18:11:04,116 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 18:11:04,116 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 18:11:04,116 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 18:11:04,116 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 18:11:04,116 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 18:11:04,116 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 18:11:04,116 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 18:11:04,116 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 18:11:04,117 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemState/7b826a753123f7e7002cdc8d54f6c0f7/cf, FileablePath, hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemState/7b826a753123f7e7002cdc8d54f6c0f7/recovered.edits] 2023-07-19 18:11:04,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-19 18:11:04,117 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemState/e8124f09fcc25aa4a1e3b78445cde42c/cf, FileablePath, hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemState/e8124f09fcc25aa4a1e3b78445cde42c/recovered.edits] 2023-07-19 18:11:04,122 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemState/e8124f09fcc25aa4a1e3b78445cde42c/cf/dd7f2fa19d4940fc8d4bbb904ceaa736 to hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/archive/data/default/testtb-testExportFileSystemState/e8124f09fcc25aa4a1e3b78445cde42c/cf/dd7f2fa19d4940fc8d4bbb904ceaa736 2023-07-19 18:11:04,122 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemState/7b826a753123f7e7002cdc8d54f6c0f7/cf/2f5feb1554bb4881ad5cd246c5a354fb to hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/archive/data/default/testtb-testExportFileSystemState/7b826a753123f7e7002cdc8d54f6c0f7/cf/2f5feb1554bb4881ad5cd246c5a354fb 2023-07-19 18:11:04,125 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemState/e8124f09fcc25aa4a1e3b78445cde42c/recovered.edits/9.seqid to hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/archive/data/default/testtb-testExportFileSystemState/e8124f09fcc25aa4a1e3b78445cde42c/recovered.edits/9.seqid 2023-07-19 18:11:04,126 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemState/7b826a753123f7e7002cdc8d54f6c0f7/recovered.edits/9.seqid to hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/archive/data/default/testtb-testExportFileSystemState/7b826a753123f7e7002cdc8d54f6c0f7/recovered.edits/9.seqid 2023-07-19 18:11:04,126 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemState/e8124f09fcc25aa4a1e3b78445cde42c 2023-07-19 18:11:04,126 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemState/7b826a753123f7e7002cdc8d54f6c0f7 2023-07-19 18:11:04,126 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-19 18:11:04,129 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-19 18:11:04,131 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-19 18:11:04,134 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-19 18:11:04,135 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-19 18:11:04,135 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-19 18:11:04,135 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689790247441.7b826a753123f7e7002cdc8d54f6c0f7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689790264135"}]},"ts":"9223372036854775807"} 2023-07-19 18:11:04,135 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689790247441.e8124f09fcc25aa4a1e3b78445cde42c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689790264135"}]},"ts":"9223372036854775807"} 2023-07-19 18:11:04,137 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-19 18:11:04,137 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 7b826a753123f7e7002cdc8d54f6c0f7, NAME => 'testtb-testExportFileSystemState,,1689790247441.7b826a753123f7e7002cdc8d54f6c0f7.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => e8124f09fcc25aa4a1e3b78445cde42c, NAME => 'testtb-testExportFileSystemState,1,1689790247441.e8124f09fcc25aa4a1e3b78445cde42c.', STARTKEY => '1', ENDKEY => ''}] 2023-07-19 18:11:04,137 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-19 18:11:04,138 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689790264137"}]},"ts":"9223372036854775807"} 2023-07-19 18:11:04,139 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-19 18:11:04,141 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-19 18:11:04,142 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 36 msec 2023-07-19 18:11:04,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-19 18:11:04,219 INFO [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-19 18:11:04,227 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-19 18:11:04,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-19 18:11:04,231 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-19 18:11:04,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-19 18:11:04,259 INFO [Listener at jenkins-hbase4.apache.org/42301] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=768 (was 757) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1228708869_1 at /127.0.0.1:48322 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3af1d18e-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2067 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x3af1d18e-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2119224145_17 at /127.0.0.1:58858 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1228708869_1 at /127.0.0.1:58846 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3af1d18e-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3af1d18e-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2119224145_17 at /127.0.0.1:56774 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2119224145_17 at /127.0.0.1:48344 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1477432893) connection to jenkins-hbase4.apache.org/172.31.14.131:41741 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=922 (was 926), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=365 (was 432), ProcessCount=182 (was 183), AvailableMemoryMB=3031 (was 3151) 2023-07-19 18:11:04,259 WARN [Listener at jenkins-hbase4.apache.org/42301] hbase.ResourceChecker(130): Thread=768 is superior to 500 2023-07-19 18:11:04,280 INFO [Listener at jenkins-hbase4.apache.org/42301] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=768, OpenFileDescriptor=922, MaxFileDescriptor=60000, SystemLoadAverage=365, ProcessCount=183, AvailableMemoryMB=3031 2023-07-19 18:11:04,280 WARN [Listener at jenkins-hbase4.apache.org/42301] hbase.ResourceChecker(130): Thread=768 is superior to 500 2023-07-19 18:11:04,282 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-19 18:11:04,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-19 18:11:04,286 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 18:11:04,286 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-19 18:11:04,287 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 18:11:04,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-19 18:11:04,290 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testConsecutiveExports/5073c5d4bf2b04bbd2cbc4f5cdabc806 2023-07-19 18:11:04,290 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testConsecutiveExports/8fa8eb7329c2dc3bd2a4dff0b8546256 2023-07-19 18:11:04,290 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testConsecutiveExports/5073c5d4bf2b04bbd2cbc4f5cdabc806 empty. 2023-07-19 18:11:04,291 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testConsecutiveExports/8fa8eb7329c2dc3bd2a4dff0b8546256 empty. 2023-07-19 18:11:04,291 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testConsecutiveExports/5073c5d4bf2b04bbd2cbc4f5cdabc806 2023-07-19 18:11:04,291 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testConsecutiveExports/8fa8eb7329c2dc3bd2a4dff0b8546256 2023-07-19 18:11:04,291 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-19 18:11:04,308 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-19 18:11:04,309 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5073c5d4bf2b04bbd2cbc4f5cdabc806, NAME => 'testtb-testConsecutiveExports,,1689790264282.5073c5d4bf2b04bbd2cbc4f5cdabc806.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp 2023-07-19 18:11:04,309 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 8fa8eb7329c2dc3bd2a4dff0b8546256, NAME => 'testtb-testConsecutiveExports,1,1689790264282.8fa8eb7329c2dc3bd2a4dff0b8546256.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp 2023-07-19 18:11:04,333 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689790264282.5073c5d4bf2b04bbd2cbc4f5cdabc806.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 18:11:04,333 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 5073c5d4bf2b04bbd2cbc4f5cdabc806, disabling compactions & flushes 2023-07-19 18:11:04,333 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689790264282.5073c5d4bf2b04bbd2cbc4f5cdabc806. 2023-07-19 18:11:04,333 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689790264282.5073c5d4bf2b04bbd2cbc4f5cdabc806. 2023-07-19 18:11:04,333 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689790264282.5073c5d4bf2b04bbd2cbc4f5cdabc806. after waiting 0 ms 2023-07-19 18:11:04,333 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689790264282.5073c5d4bf2b04bbd2cbc4f5cdabc806. 2023-07-19 18:11:04,333 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689790264282.5073c5d4bf2b04bbd2cbc4f5cdabc806. 2023-07-19 18:11:04,333 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 5073c5d4bf2b04bbd2cbc4f5cdabc806: 2023-07-19 18:11:04,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-19 18:11:04,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-19 18:11:04,733 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689790264282.8fa8eb7329c2dc3bd2a4dff0b8546256.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 18:11:04,734 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 8fa8eb7329c2dc3bd2a4dff0b8546256, disabling compactions & flushes 2023-07-19 18:11:04,734 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689790264282.8fa8eb7329c2dc3bd2a4dff0b8546256. 2023-07-19 18:11:04,734 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689790264282.8fa8eb7329c2dc3bd2a4dff0b8546256. 2023-07-19 18:11:04,734 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689790264282.8fa8eb7329c2dc3bd2a4dff0b8546256. after waiting 0 ms 2023-07-19 18:11:04,734 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689790264282.8fa8eb7329c2dc3bd2a4dff0b8546256. 2023-07-19 18:11:04,734 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689790264282.8fa8eb7329c2dc3bd2a4dff0b8546256. 2023-07-19 18:11:04,734 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 8fa8eb7329c2dc3bd2a4dff0b8546256: 2023-07-19 18:11:04,737 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 18:11:04,738 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689790264282.5073c5d4bf2b04bbd2cbc4f5cdabc806.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689790264738"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689790264738"}]},"ts":"1689790264738"} 2023-07-19 18:11:04,738 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689790264282.8fa8eb7329c2dc3bd2a4dff0b8546256.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689790264738"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689790264738"}]},"ts":"1689790264738"} 2023-07-19 18:11:04,740 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 18:11:04,741 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 18:11:04,742 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689790264741"}]},"ts":"1689790264741"} 2023-07-19 18:11:04,743 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-19 18:11:04,747 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 18:11:04,748 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 18:11:04,749 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 18:11:04,749 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 18:11:04,749 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 18:11:04,749 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5073c5d4bf2b04bbd2cbc4f5cdabc806, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8fa8eb7329c2dc3bd2a4dff0b8546256, ASSIGN}] 2023-07-19 18:11:04,752 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5073c5d4bf2b04bbd2cbc4f5cdabc806, ASSIGN 2023-07-19 18:11:04,752 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8fa8eb7329c2dc3bd2a4dff0b8546256, ASSIGN 2023-07-19 18:11:04,753 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5073c5d4bf2b04bbd2cbc4f5cdabc806, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40317,1689790219525; forceNewPlan=false, retain=false 2023-07-19 18:11:04,753 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8fa8eb7329c2dc3bd2a4dff0b8546256, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44407,1689790219668; forceNewPlan=false, retain=false 2023-07-19 18:11:04,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-19 18:11:04,903 INFO [jenkins-hbase4:40453] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 18:11:04,906 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=5073c5d4bf2b04bbd2cbc4f5cdabc806, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:04,906 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=8fa8eb7329c2dc3bd2a4dff0b8546256, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:04,906 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689790264282.5073c5d4bf2b04bbd2cbc4f5cdabc806.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689790264906"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689790264906"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689790264906"}]},"ts":"1689790264906"} 2023-07-19 18:11:04,906 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689790264282.8fa8eb7329c2dc3bd2a4dff0b8546256.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689790264906"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689790264906"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689790264906"}]},"ts":"1689790264906"} 2023-07-19 18:11:04,908 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure 5073c5d4bf2b04bbd2cbc4f5cdabc806, server=jenkins-hbase4.apache.org,40317,1689790219525}] 2023-07-19 18:11:04,909 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure 8fa8eb7329c2dc3bd2a4dff0b8546256, server=jenkins-hbase4.apache.org,44407,1689790219668}] 2023-07-19 18:11:05,067 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689790264282.8fa8eb7329c2dc3bd2a4dff0b8546256. 2023-07-19 18:11:05,067 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8fa8eb7329c2dc3bd2a4dff0b8546256, NAME => 'testtb-testConsecutiveExports,1,1689790264282.8fa8eb7329c2dc3bd2a4dff0b8546256.', STARTKEY => '1', ENDKEY => ''} 2023-07-19 18:11:05,068 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689790264282.5073c5d4bf2b04bbd2cbc4f5cdabc806. 2023-07-19 18:11:05,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689790264282.8fa8eb7329c2dc3bd2a4dff0b8546256. service=AccessControlService 2023-07-19 18:11:05,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5073c5d4bf2b04bbd2cbc4f5cdabc806, NAME => 'testtb-testConsecutiveExports,,1689790264282.5073c5d4bf2b04bbd2cbc4f5cdabc806.', STARTKEY => '', ENDKEY => '1'} 2023-07-19 18:11:05,068 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 18:11:05,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689790264282.5073c5d4bf2b04bbd2cbc4f5cdabc806. service=AccessControlService 2023-07-19 18:11:05,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 8fa8eb7329c2dc3bd2a4dff0b8546256 2023-07-19 18:11:05,068 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 18:11:05,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689790264282.8fa8eb7329c2dc3bd2a4dff0b8546256.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 18:11:05,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 5073c5d4bf2b04bbd2cbc4f5cdabc806 2023-07-19 18:11:05,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8fa8eb7329c2dc3bd2a4dff0b8546256 2023-07-19 18:11:05,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689790264282.5073c5d4bf2b04bbd2cbc4f5cdabc806.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 18:11:05,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8fa8eb7329c2dc3bd2a4dff0b8546256 2023-07-19 18:11:05,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5073c5d4bf2b04bbd2cbc4f5cdabc806 2023-07-19 18:11:05,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5073c5d4bf2b04bbd2cbc4f5cdabc806 2023-07-19 18:11:05,070 INFO [StoreOpener-8fa8eb7329c2dc3bd2a4dff0b8546256-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8fa8eb7329c2dc3bd2a4dff0b8546256 2023-07-19 18:11:05,070 INFO [StoreOpener-5073c5d4bf2b04bbd2cbc4f5cdabc806-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5073c5d4bf2b04bbd2cbc4f5cdabc806 2023-07-19 18:11:05,072 DEBUG [StoreOpener-8fa8eb7329c2dc3bd2a4dff0b8546256-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testConsecutiveExports/8fa8eb7329c2dc3bd2a4dff0b8546256/cf 2023-07-19 18:11:05,072 DEBUG [StoreOpener-8fa8eb7329c2dc3bd2a4dff0b8546256-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testConsecutiveExports/8fa8eb7329c2dc3bd2a4dff0b8546256/cf 2023-07-19 18:11:05,073 INFO [StoreOpener-8fa8eb7329c2dc3bd2a4dff0b8546256-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8fa8eb7329c2dc3bd2a4dff0b8546256 columnFamilyName cf 2023-07-19 18:11:05,073 INFO [StoreOpener-8fa8eb7329c2dc3bd2a4dff0b8546256-1] regionserver.HStore(310): Store=8fa8eb7329c2dc3bd2a4dff0b8546256/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 18:11:05,073 DEBUG [StoreOpener-5073c5d4bf2b04bbd2cbc4f5cdabc806-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testConsecutiveExports/5073c5d4bf2b04bbd2cbc4f5cdabc806/cf 2023-07-19 18:11:05,074 DEBUG [StoreOpener-5073c5d4bf2b04bbd2cbc4f5cdabc806-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testConsecutiveExports/5073c5d4bf2b04bbd2cbc4f5cdabc806/cf 2023-07-19 18:11:05,074 INFO [StoreOpener-5073c5d4bf2b04bbd2cbc4f5cdabc806-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5073c5d4bf2b04bbd2cbc4f5cdabc806 columnFamilyName cf 2023-07-19 18:11:05,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testConsecutiveExports/8fa8eb7329c2dc3bd2a4dff0b8546256 2023-07-19 18:11:05,078 INFO [StoreOpener-5073c5d4bf2b04bbd2cbc4f5cdabc806-1] regionserver.HStore(310): Store=5073c5d4bf2b04bbd2cbc4f5cdabc806/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 18:11:05,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testConsecutiveExports/8fa8eb7329c2dc3bd2a4dff0b8546256 2023-07-19 18:11:05,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testConsecutiveExports/5073c5d4bf2b04bbd2cbc4f5cdabc806 2023-07-19 18:11:05,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testConsecutiveExports/5073c5d4bf2b04bbd2cbc4f5cdabc806 2023-07-19 18:11:05,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8fa8eb7329c2dc3bd2a4dff0b8546256 2023-07-19 18:11:05,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5073c5d4bf2b04bbd2cbc4f5cdabc806 2023-07-19 18:11:05,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testConsecutiveExports/8fa8eb7329c2dc3bd2a4dff0b8546256/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 18:11:05,084 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8fa8eb7329c2dc3bd2a4dff0b8546256; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72270828, jitterRate=0.07691925764083862}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 18:11:05,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8fa8eb7329c2dc3bd2a4dff0b8546256: 2023-07-19 18:11:05,085 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689790264282.8fa8eb7329c2dc3bd2a4dff0b8546256., pid=46, masterSystemTime=1689790265060 2023-07-19 18:11:05,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testConsecutiveExports/5073c5d4bf2b04bbd2cbc4f5cdabc806/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 18:11:05,086 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5073c5d4bf2b04bbd2cbc4f5cdabc806; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66823812, jitterRate=-0.004247605800628662}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 18:11:05,086 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5073c5d4bf2b04bbd2cbc4f5cdabc806: 2023-07-19 18:11:05,087 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689790264282.5073c5d4bf2b04bbd2cbc4f5cdabc806., pid=45, masterSystemTime=1689790265060 2023-07-19 18:11:05,088 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689790264282.8fa8eb7329c2dc3bd2a4dff0b8546256. 2023-07-19 18:11:05,088 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689790264282.8fa8eb7329c2dc3bd2a4dff0b8546256. 2023-07-19 18:11:05,088 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=8fa8eb7329c2dc3bd2a4dff0b8546256, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:05,088 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689790264282.8fa8eb7329c2dc3bd2a4dff0b8546256.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689790265088"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689790265088"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689790265088"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689790265088"}]},"ts":"1689790265088"} 2023-07-19 18:11:05,090 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689790264282.5073c5d4bf2b04bbd2cbc4f5cdabc806. 2023-07-19 18:11:05,090 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689790264282.5073c5d4bf2b04bbd2cbc4f5cdabc806. 2023-07-19 18:11:05,090 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=5073c5d4bf2b04bbd2cbc4f5cdabc806, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:05,091 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689790264282.5073c5d4bf2b04bbd2cbc4f5cdabc806.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689790265090"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689790265090"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689790265090"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689790265090"}]},"ts":"1689790265090"} 2023-07-19 18:11:05,093 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=44 2023-07-19 18:11:05,094 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure 8fa8eb7329c2dc3bd2a4dff0b8546256, server=jenkins-hbase4.apache.org,44407,1689790219668 in 182 msec 2023-07-19 18:11:05,096 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=43 2023-07-19 18:11:05,096 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure 5073c5d4bf2b04bbd2cbc4f5cdabc806, server=jenkins-hbase4.apache.org,40317,1689790219525 in 185 msec 2023-07-19 18:11:05,097 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8fa8eb7329c2dc3bd2a4dff0b8546256, ASSIGN in 344 msec 2023-07-19 18:11:05,099 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=42 2023-07-19 18:11:05,099 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5073c5d4bf2b04bbd2cbc4f5cdabc806, ASSIGN in 347 msec 2023-07-19 18:11:05,099 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 18:11:05,100 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689790265099"}]},"ts":"1689790265099"} 2023-07-19 18:11:05,101 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-19 18:11:05,104 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 18:11:05,104 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-19 18:11:05,107 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33037] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-19 18:11:05,108 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 18:11:05,109 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 18:11:05,109 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 18:11:05,108 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 18:11:05,110 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-19 18:11:05,110 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-19 18:11:05,110 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-19 18:11:05,111 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-19 18:11:05,112 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 828 msec 2023-07-19 18:11:05,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-19 18:11:05,393 INFO [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-19 18:11:05,393 DEBUG [Listener at jenkins-hbase4.apache.org/42301] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testConsecutiveExports get assigned. Timeout = 60000ms 2023-07-19 18:11:05,394 INFO [Listener at jenkins-hbase4.apache.org/42301] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 18:11:05,397 INFO [Listener at jenkins-hbase4.apache.org/42301] hbase.HBaseTestingUtility(3484): All regions for table testtb-testConsecutiveExports assigned to meta. Checking AM states. 2023-07-19 18:11:05,397 INFO [Listener at jenkins-hbase4.apache.org/42301] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 18:11:05,397 INFO [Listener at jenkins-hbase4.apache.org/42301] hbase.HBaseTestingUtility(3504): All regions for table testtb-testConsecutiveExports assigned. 2023-07-19 18:11:05,400 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-19 18:11:05,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689790265400 (current time:1689790265400). 2023-07-19 18:11:05,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 18:11:05,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] zookeeper.ReadOnlyZKClient(139): Connect 0x4fe05bb6 to 127.0.0.1:51604 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 18:11:05,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@12c1583e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 18:11:05,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 18:11:05,411 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41200, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 18:11:05,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4fe05bb6 to 127.0.0.1:51604 2023-07-19 18:11:05,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 18:11:05,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] zookeeper.ReadOnlyZKClient(139): Connect 0x31e4a176 to 127.0.0.1:51604 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 18:11:05,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7c947117, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 18:11:05,423 DEBUG [hconnection-0x648cd613-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 18:11:05,427 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41208, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 18:11:05,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x31e4a176 to 127.0.0.1:51604 2023-07-19 18:11:05,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 18:11:05,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-19 18:11:05,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 18:11:05,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-19 18:11:05,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-19 18:11:05,439 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-19 18:11:05,440 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689790865440 2023-07-19 18:11:05,440 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-19 18:11:05,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-19 18:11:05,442 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 18:11:05,442 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 18:11:05,443 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-19 18:11:05,448 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-19 18:11:05,450 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 12 msec 2023-07-19 18:11:05,454 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-19 18:11:05,455 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689790865455 2023-07-19 18:11:05,486 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-19 18:11:05,486 INFO [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-19 18:11:05,486 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 18:11:05,488 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-19 18:11:05,488 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-19 18:11:05,489 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 18:11:05,489 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 18:11:05,490 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:11:05,490 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:05,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:11:05,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:11:05,490 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:11:05,490 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:11:05,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:11:05,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:11:05,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:11:05,491 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:05,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:11:05,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 18:11:05,491 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:05,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 18:11:05,492 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 18:11:05,492 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:05,492 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 18:11:05,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 18:11:05,492 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 18:11:05,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-19 18:11:05,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 18:11:05,492 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 18:11:05,492 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-19 18:11:05,493 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-19 18:11:05,493 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-19 18:11:05,493 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 18:11:05,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-19 18:11:05,495 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-19 18:11:05,495 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-19 18:11:05,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 18:11:05,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-19 18:11:05,495 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33037,1689790219604' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-19 18:11:05,495 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-19 18:11:05,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 18:11:05,496 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-19 18:11:05,496 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-19 18:11:05,496 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-19 18:11:05,496 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 18:11:05,496 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-19 18:11:05,496 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-19 18:11:05,498 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 18:11:05,498 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-19 18:11:05,498 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-19 18:11:05,498 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40317,1689790219525' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-19 18:11:05,498 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 18:11:05,503 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-19 18:11:05,503 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-19 18:11:05,503 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44407,1689790219668' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-19 18:11:05,504 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 18:11:05,504 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 18:11:05,506 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:05,506 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 18:11:05,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:05,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 18:11:05,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 18:11:05,507 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:05,507 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 18:11:05,507 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 18:11:05,507 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 18:11:05,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 18:11:05,507 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 18:11:05,507 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 18:11:05,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 18:11:05,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 18:11:05,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:05,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:05,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:05,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 18:11:05,510 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40317,1689790219525' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-19 18:11:05,510 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1c2ce177[Count = 1] remaining members to acquire global barrier 2023-07-19 18:11:05,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:05,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 18:11:05,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 18:11:05,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 18:11:05,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 18:11:05,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 18:11:05,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:05,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:05,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:05,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 18:11:05,513 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44407,1689790219668' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-19 18:11:05,513 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1c2ce177[Count = 0] remaining members to acquire global barrier 2023-07-19 18:11:05,513 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-19 18:11:05,513 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 18:11:05,514 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 18:11:05,515 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 18:11:05,515 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 18:11:05,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 18:11:05,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 18:11:05,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 18:11:05,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 18:11:05,515 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-19 18:11:05,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 18:11:05,518 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 18:11:05,519 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-19 18:11:05,515 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:05,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 18:11:05,519 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 18:11:05,519 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-19 18:11:05,519 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-19 18:11:05,519 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689790264282.5073c5d4bf2b04bbd2cbc4f5cdabc806. 2023-07-19 18:11:05,519 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,33037,1689790219604' in zk 2023-07-19 18:11:05,519 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689790264282.5073c5d4bf2b04bbd2cbc4f5cdabc806. started... 2023-07-19 18:11:05,520 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:05,520 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 18:11:05,522 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 18:11:05,532 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 18:11:05,532 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-19 18:11:05,532 DEBUG [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689790264282.8fa8eb7329c2dc3bd2a4dff0b8546256. 2023-07-19 18:11:05,533 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 18:11:05,533 DEBUG [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689790264282.8fa8eb7329c2dc3bd2a4dff0b8546256. started... 2023-07-19 18:11:05,533 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-19 18:11:05,534 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5073c5d4bf2b04bbd2cbc4f5cdabc806: 2023-07-19 18:11:05,536 DEBUG [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8fa8eb7329c2dc3bd2a4dff0b8546256: 2023-07-19 18:11:05,536 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689790264282.5073c5d4bf2b04bbd2cbc4f5cdabc806.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-19 18:11:05,536 DEBUG [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689790264282.8fa8eb7329c2dc3bd2a4dff0b8546256.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-19 18:11:05,536 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 18:11:05,538 DEBUG [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 18:11:05,538 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 18:11:05,538 DEBUG [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 18:11:05,542 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 18:11:05,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-19 18:11:05,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-19 18:11:05,544 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 18:11:05,574 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689790264282.5073c5d4bf2b04bbd2cbc4f5cdabc806. completed. 2023-07-19 18:11:05,574 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689790264282.5073c5d4bf2b04bbd2cbc4f5cdabc806. 2023-07-19 18:11:05,574 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 18:11:05,574 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 18:11:05,574 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:05,574 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-19 18:11:05,574 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,40317,1689790219525' in zk 2023-07-19 18:11:05,578 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:05,579 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-19 18:11:05,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:05,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 18:11:05,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 18:11:05,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 18:11:05,579 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 18:11:05,580 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-19 18:11:05,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 18:11:05,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 18:11:05,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:05,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:05,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:05,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 18:11:05,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 18:11:05,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:05,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:05,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,40317,1689790219525': 2023-07-19 18:11:05,586 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40317,1689790219525' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-19 18:11:05,602 DEBUG [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689790264282.8fa8eb7329c2dc3bd2a4dff0b8546256. completed. 2023-07-19 18:11:05,602 DEBUG [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689790264282.8fa8eb7329c2dc3bd2a4dff0b8546256. 2023-07-19 18:11:05,602 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 18:11:05,602 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 18:11:05,602 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:05,602 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-19 18:11:05,602 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,44407,1689790219668' in zk 2023-07-19 18:11:05,604 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:05,604 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-19 18:11:05,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:05,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 18:11:05,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 18:11:05,604 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 18:11:05,605 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-19 18:11:05,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 18:11:05,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 18:11:05,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 18:11:05,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:05,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:05,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:05,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 18:11:05,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 18:11:05,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:05,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:05,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:05,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,44407,1689790219668': 2023-07-19 18:11:05,611 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44407,1689790219668' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-19 18:11:05,612 INFO [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-19 18:11:05,612 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 18:11:05,612 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 18:11:05,612 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-19 18:11:05,612 INFO [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 18:11:05,614 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 18:11:05,614 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 18:11:05,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 18:11:05,614 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 18:11:05,614 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 18:11:05,614 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:11:05,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 18:11:05,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 18:11:05,614 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:11:05,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 18:11:05,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 18:11:05,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 18:11:05,614 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:11:05,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:11:05,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 18:11:05,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 18:11:05,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 18:11:05,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:11:05,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 18:11:05,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:11:05,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:11:05,615 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:05,616 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:11:05,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:11:05,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 18:11:05,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 18:11:05,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 18:11:05,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 18:11:05,616 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:05,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 18:11:05,617 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:05,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 18:11:05,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:05,619 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:05,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:05,621 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:05,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:05,621 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:05,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 18:11:05,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 18:11:05,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:05,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:05,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:05,624 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:05,624 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 18:11:05,624 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:05,624 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:05,624 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 18:11:05,625 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:11:05,625 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:05,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:11:05,625 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:11:05,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:11:05,625 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:11:05,625 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:11:05,625 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 18:11:05,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:11:05,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:11:05,625 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:11:05,625 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:05,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:11:05,625 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:11:05,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:11:05,625 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:05,626 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 18:11:05,626 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 18:11:05,626 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:11:05,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:11:05,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:11:05,626 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports because node does not exist (not an error) 2023-07-19 18:11:05,626 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:11:05,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:11:05,626 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-19 18:11:05,626 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 18:11:05,626 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-19 18:11:05,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:11:05,629 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-19 18:11:05,658 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-19 18:11:05,708 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-19 18:11:05,708 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-19 18:11:05,708 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-19 18:11:05,708 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689790265440Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689790265626 (+186 ms)Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689790265628 (+2 ms)Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689790265632 (+4 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689790265651 (+19 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689790265708 (+57 ms) 2023-07-19 18:11:05,712 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-19 18:11:05,715 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 271 msec 2023-07-19 18:11:05,744 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 18:11:05,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-19 18:11:05,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 18:11:05,755 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40317] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689790264282.5073c5d4bf2b04bbd2cbc4f5cdabc806. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 18:11:05,756 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44407] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689790264282.8fa8eb7329c2dc3bd2a4dff0b8546256. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 18:11:05,759 DEBUG [Listener at jenkins-hbase4.apache.org/42301] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-19 18:11:05,760 DEBUG [Listener at jenkins-hbase4.apache.org/42301] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689790264282.5073c5d4bf2b04bbd2cbc4f5cdabc806. 2023-07-19 18:11:05,761 INFO [Listener at jenkins-hbase4.apache.org/42301] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 18:11:05,781 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-19 18:11:05,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689790265781 (current time:1689790265781). 2023-07-19 18:11:05,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 18:11:05,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] zookeeper.ReadOnlyZKClient(139): Connect 0x7dbe1fe4 to 127.0.0.1:51604 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 18:11:05,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4c4d9573, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 18:11:05,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 18:11:05,807 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41212, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 18:11:05,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7dbe1fe4 to 127.0.0.1:51604 2023-07-19 18:11:05,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 18:11:05,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] zookeeper.ReadOnlyZKClient(139): Connect 0x3d95c0e3 to 127.0.0.1:51604 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 18:11:05,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@30d9a98a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 18:11:05,817 DEBUG [hconnection-0x101f54ef-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 18:11:05,818 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41220, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 18:11:05,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3d95c0e3 to 127.0.0.1:51604 2023-07-19 18:11:05,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 18:11:05,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-19 18:11:05,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 18:11:05,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-19 18:11:05,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-19 18:11:05,829 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-19 18:11:05,830 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689790865830 2023-07-19 18:11:05,830 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-19 18:11:05,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-19 18:11:05,832 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 18:11:05,832 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 18:11:05,832 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-19 18:11:05,833 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-19 18:11:05,835 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 7 msec 2023-07-19 18:11:05,836 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-19 18:11:05,837 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689790865837 2023-07-19 18:11:05,853 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-19 18:11:05,853 INFO [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-19 18:11:05,853 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 18:11:05,855 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-19 18:11:05,855 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-19 18:11:05,855 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 18:11:05,855 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 18:11:05,856 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:11:05,856 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:05,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:11:05,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:11:05,856 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:11:05,856 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:11:05,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:11:05,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:11:05,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:11:05,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:11:05,857 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:05,857 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:05,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 18:11:05,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 18:11:05,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 18:11:05,857 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:05,857 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 18:11:05,857 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 18:11:05,858 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 18:11:05,858 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 18:11:05,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-19 18:11:05,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 18:11:05,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-19 18:11:05,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-19 18:11:05,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 18:11:05,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 18:11:05,858 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-19 18:11:05,858 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-19 18:11:05,858 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-19 18:11:05,858 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-19 18:11:05,859 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-19 18:11:05,859 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-19 18:11:05,859 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 18:11:05,859 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-19 18:11:05,859 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 18:11:05,859 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-19 18:11:05,859 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-19 18:11:05,859 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 18:11:05,861 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-19 18:11:05,861 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-19 18:11:05,861 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-19 18:11:05,861 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-19 18:11:05,861 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33037,1689790219604' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-19 18:11:05,861 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-19 18:11:05,861 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-19 18:11:05,861 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40317,1689790219525' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-19 18:11:05,861 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44407,1689790219668' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-19 18:11:05,863 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 18:11:05,864 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 18:11:05,864 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:05,864 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 18:11:05,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:05,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 18:11:05,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 18:11:05,864 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 18:11:05,864 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 18:11:05,864 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:05,865 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 18:11:05,865 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 18:11:05,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 18:11:05,865 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 18:11:05,865 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 18:11:05,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 18:11:05,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 18:11:05,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:05,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:05,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:05,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 18:11:05,867 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40317,1689790219525' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-19 18:11:05,867 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4f60efe7[Count = 1] remaining members to acquire global barrier 2023-07-19 18:11:05,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:05,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 18:11:05,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 18:11:05,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 18:11:05,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 18:11:05,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 18:11:05,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:05,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:05,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:05,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 18:11:05,869 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44407,1689790219668' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-19 18:11:05,869 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4f60efe7[Count = 0] remaining members to acquire global barrier 2023-07-19 18:11:05,869 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-19 18:11:05,869 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 18:11:05,870 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 18:11:05,870 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 18:11:05,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 18:11:05,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 18:11:05,870 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 18:11:05,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 18:11:05,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 18:11:05,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 18:11:05,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 18:11:05,871 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-19 18:11:05,871 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-19 18:11:05,871 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-19 18:11:05,870 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:05,871 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-19 18:11:05,871 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,33037,1689790219604' in zk 2023-07-19 18:11:05,871 DEBUG [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689790264282.8fa8eb7329c2dc3bd2a4dff0b8546256. 2023-07-19 18:11:05,871 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 18:11:05,871 DEBUG [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689790264282.8fa8eb7329c2dc3bd2a4dff0b8546256. started... 2023-07-19 18:11:05,871 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 18:11:05,871 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689790264282.5073c5d4bf2b04bbd2cbc4f5cdabc806. 2023-07-19 18:11:05,871 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:05,871 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 18:11:05,871 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 18:11:05,871 INFO [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 8fa8eb7329c2dc3bd2a4dff0b8546256 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-19 18:11:05,871 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 18:11:05,871 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689790264282.5073c5d4bf2b04bbd2cbc4f5cdabc806. started... 2023-07-19 18:11:05,872 INFO [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 5073c5d4bf2b04bbd2cbc4f5cdabc806 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-19 18:11:05,873 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-19 18:11:05,873 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 18:11:05,873 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-19 18:11:05,895 INFO [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=333 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testConsecutiveExports/5073c5d4bf2b04bbd2cbc4f5cdabc806/.tmp/cf/f04e2d8263e14a9984021325b8e2b497 2023-07-19 18:11:05,895 INFO [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.93 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testConsecutiveExports/8fa8eb7329c2dc3bd2a4dff0b8546256/.tmp/cf/977e91c5ca984984873d51dba2b47cd8 2023-07-19 18:11:05,903 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testConsecutiveExports/5073c5d4bf2b04bbd2cbc4f5cdabc806/.tmp/cf/f04e2d8263e14a9984021325b8e2b497 as hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testConsecutiveExports/5073c5d4bf2b04bbd2cbc4f5cdabc806/cf/f04e2d8263e14a9984021325b8e2b497 2023-07-19 18:11:05,903 DEBUG [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testConsecutiveExports/8fa8eb7329c2dc3bd2a4dff0b8546256/.tmp/cf/977e91c5ca984984873d51dba2b47cd8 as hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testConsecutiveExports/8fa8eb7329c2dc3bd2a4dff0b8546256/cf/977e91c5ca984984873d51dba2b47cd8 2023-07-19 18:11:05,908 INFO [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testConsecutiveExports/5073c5d4bf2b04bbd2cbc4f5cdabc806/cf/f04e2d8263e14a9984021325b8e2b497, entries=5, sequenceid=6, filesize=5.2 K 2023-07-19 18:11:05,909 INFO [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testConsecutiveExports/8fa8eb7329c2dc3bd2a4dff0b8546256/cf/977e91c5ca984984873d51dba2b47cd8, entries=45, sequenceid=6, filesize=7.9 K 2023-07-19 18:11:05,910 INFO [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 5073c5d4bf2b04bbd2cbc4f5cdabc806 in 38ms, sequenceid=6, compaction requested=false 2023-07-19 18:11:05,910 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-19 18:11:05,910 INFO [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 8fa8eb7329c2dc3bd2a4dff0b8546256 in 39ms, sequenceid=6, compaction requested=false 2023-07-19 18:11:05,910 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5073c5d4bf2b04bbd2cbc4f5cdabc806: 2023-07-19 18:11:05,912 DEBUG [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8fa8eb7329c2dc3bd2a4dff0b8546256: 2023-07-19 18:11:05,916 DEBUG [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689790264282.8fa8eb7329c2dc3bd2a4dff0b8546256.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-19 18:11:05,916 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689790264282.5073c5d4bf2b04bbd2cbc4f5cdabc806.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-19 18:11:05,916 DEBUG [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 18:11:05,916 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 18:11:05,916 DEBUG [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testConsecutiveExports/8fa8eb7329c2dc3bd2a4dff0b8546256/cf/977e91c5ca984984873d51dba2b47cd8] hfiles 2023-07-19 18:11:05,916 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testConsecutiveExports/5073c5d4bf2b04bbd2cbc4f5cdabc806/cf/f04e2d8263e14a9984021325b8e2b497] hfiles 2023-07-19 18:11:05,916 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testConsecutiveExports/5073c5d4bf2b04bbd2cbc4f5cdabc806/cf/f04e2d8263e14a9984021325b8e2b497 for snapshot=snaptb0-testConsecutiveExports 2023-07-19 18:11:05,916 DEBUG [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testConsecutiveExports/8fa8eb7329c2dc3bd2a4dff0b8546256/cf/977e91c5ca984984873d51dba2b47cd8 for snapshot=snaptb0-testConsecutiveExports 2023-07-19 18:11:05,928 DEBUG [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689790264282.8fa8eb7329c2dc3bd2a4dff0b8546256. completed. 2023-07-19 18:11:05,928 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689790264282.5073c5d4bf2b04bbd2cbc4f5cdabc806. completed. 2023-07-19 18:11:05,928 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689790264282.5073c5d4bf2b04bbd2cbc4f5cdabc806. 2023-07-19 18:11:05,928 DEBUG [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689790264282.8fa8eb7329c2dc3bd2a4dff0b8546256. 2023-07-19 18:11:05,928 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 18:11:05,928 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 18:11:05,928 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:05,928 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 18:11:05,928 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 18:11:05,928 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-19 18:11:05,928 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:05,928 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,40317,1689790219525' in zk 2023-07-19 18:11:05,928 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-19 18:11:05,928 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,44407,1689790219668' in zk 2023-07-19 18:11:05,931 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-19 18:11:05,931 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:05,931 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-19 18:11:05,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:05,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 18:11:05,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 18:11:05,931 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 18:11:05,931 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:05,932 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-19 18:11:05,931 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 18:11:05,933 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 18:11:05,933 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-19 18:11:05,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 18:11:05,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 18:11:05,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 18:11:05,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:05,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-19 18:11:05,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-19 18:11:05,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:05,936 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 18:11:05,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:05,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 18:11:05,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 18:11:05,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:05,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:05,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:05,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,40317,1689790219525': 2023-07-19 18:11:05,938 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40317,1689790219525' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-19 18:11:05,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:05,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 18:11:05,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 18:11:05,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 18:11:05,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 18:11:05,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 18:11:05,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:05,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:05,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:05,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 18:11:05,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 18:11:05,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:05,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:05,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:05,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,44407,1689790219668': 2023-07-19 18:11:05,941 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44407,1689790219668' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-19 18:11:05,941 INFO [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-19 18:11:05,941 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 18:11:05,941 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 18:11:05,941 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-19 18:11:05,941 INFO [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 18:11:05,943 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 18:11:05,943 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 18:11:05,943 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:11:05,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 18:11:05,943 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 18:11:05,943 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 18:11:05,943 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:11:05,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 18:11:05,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 18:11:05,943 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:11:05,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 18:11:05,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 18:11:05,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 18:11:05,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 18:11:05,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 18:11:05,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:11:05,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 18:11:05,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:11:05,944 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:05,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:11:05,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:11:05,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 18:11:05,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:11:05,945 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:05,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:11:05,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 18:11:05,946 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:05,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 18:11:05,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 18:11:05,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 18:11:05,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 18:11:05,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 18:11:05,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:05,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:05,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:05,948 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:05,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 18:11:05,949 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:05,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 18:11:05,949 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:05,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:05,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:05,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:05,958 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:11:05,958 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:05,958 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:11:05,958 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:11:05,959 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-19 18:11:05,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:11:05,959 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-19 18:11:05,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:11:05,959 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:11:05,959 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:11:05,959 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:11:05,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:11:05,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:11:05,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:11:05,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:11:05,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:11:05,959 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 18:11:05,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:11:05,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:11:05,959 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 18:11:05,960 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 18:11:05,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:11:05,962 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:05,962 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:05,962 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 18:11:05,962 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:05,962 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 18:11:05,962 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:05,962 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:05,962 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 18:11:05,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:11:05,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:11:05,962 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 18:11:05,985 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-19 18:11:06,013 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-19 18:11:06,014 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 18:11:06,014 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 18:11:06,014 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689790265830Consolidate snapshot: snaptb0-testConsecutiveExports at 1689790265959 (+129 ms)Loading Region manifests for snaptb0-testConsecutiveExports at 1689790265959Writing data manifest for snaptb0-testConsecutiveExports at 1689790265968 (+9 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689790265978 (+10 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689790266013 (+35 ms) 2023-07-19 18:11:06,017 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-19 18:11:06,018 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 185 msec 2023-07-19 18:11:06,136 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 18:11:06,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-19 18:11:06,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 18:11:06,138 INFO [Listener at jenkins-hbase4.apache.org/42301] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/local-export-1689790266138 2023-07-19 18:11:06,138 INFO [Listener at jenkins-hbase4.apache.org/42301] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/local-export-1689790266138, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/local-export-1689790266138, srcFsUri=hdfs://localhost:40881, srcDir=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf 2023-07-19 18:11:06,161 DEBUG [Listener at jenkins-hbase4.apache.org/42301] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:40881, inputRoot=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf 2023-07-19 18:11:06,161 DEBUG [Listener at jenkins-hbase4.apache.org/42301] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@36e5fdd4, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/local-export-1689790266138, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/local-export-1689790266138/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 18:11:06,161 INFO [Listener at jenkins-hbase4.apache.org/42301] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:40881, inputRoot=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf, snapshotDir=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-19 18:11:06,170 INFO [Listener at jenkins-hbase4.apache.org/42301] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/local-export-1689790266138/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 18:11:06,186 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 18:11:06,187 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 18:11:06,187 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 18:11:06,188 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 18:11:06,188 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-19 18:11:06,189 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 18:11:06,189 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 18:11:06,262 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/hadoop-2074512807490943421.jar 2023-07-19 18:11:06,262 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 18:11:06,263 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 18:11:06,263 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 18:11:06,263 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 18:11:06,264 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 18:11:06,264 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 18:11:06,264 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 18:11:06,265 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 18:11:06,265 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 18:11:06,265 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 18:11:06,266 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 18:11:06,266 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 18:11:06,266 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 18:11:06,267 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 18:11:06,267 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 18:11:06,268 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 18:11:06,268 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 18:11:06,268 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 18:11:06,269 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 18:11:06,269 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 18:11:06,269 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 18:11:06,269 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 18:11:06,270 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 18:11:07,103 WARN [Listener at jenkins-hbase4.apache.org/42301] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 18:11:07,106 INFO [Listener at jenkins-hbase4.apache.org/42301] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-19 18:11:07,108 DEBUG [Listener at jenkins-hbase4.apache.org/42301] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-19 18:11:07,987 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 18:11:07,987 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 18:11:07,990 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689790227140_0002_000001 (auth:SIMPLE) 2023-07-19 18:11:08,408 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689790227140_0003_000001 (auth:SIMPLE) 2023-07-19 18:11:09,572 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 18:11:12,797 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689790227140_0003_000001 (auth:SIMPLE) 2023-07-19 18:11:15,087 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689790227140_0003_000001 (auth:SIMPLE) 2023-07-19 18:11:18,341 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689790227140_0003_000001 (auth:SIMPLE) 2023-07-19 18:11:20,296 INFO [Listener at jenkins-hbase4.apache.org/42301] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 18:11:20,296 INFO [Listener at jenkins-hbase4.apache.org/42301] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 18:11:20,299 INFO [Listener at jenkins-hbase4.apache.org/42301] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-19 18:11:20,299 INFO [Listener at jenkins-hbase4.apache.org/42301] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 18:11:20,300 INFO [Listener at jenkins-hbase4.apache.org/42301] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 18:11:20,300 DEBUG [Listener at jenkins-hbase4.apache.org/42301] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2119224145_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-19 18:11:20,303 DEBUG [Listener at jenkins-hbase4.apache.org/42301] snapshot.TestExportSnapshot(367): hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-19 18:11:20,303 DEBUG [Listener at jenkins-hbase4.apache.org/42301] snapshot.TestExportSnapshot(367): hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-19 18:11:20,303 DEBUG [Listener at jenkins-hbase4.apache.org/42301] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@5798943b in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/local-export-1689790266138/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/local-export-1689790266138/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-19 18:11:20,303 DEBUG [Listener at jenkins-hbase4.apache.org/42301] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/local-export-1689790266138/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-19 18:11:20,303 DEBUG [Listener at jenkins-hbase4.apache.org/42301] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/local-export-1689790266138/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-19 18:11:20,304 INFO [Listener at jenkins-hbase4.apache.org/42301] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/local-export-1689790266138, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/local-export-1689790266138, srcFsUri=hdfs://localhost:40881, srcDir=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf 2023-07-19 18:11:20,326 DEBUG [Listener at jenkins-hbase4.apache.org/42301] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:40881, inputRoot=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf 2023-07-19 18:11:20,326 DEBUG [Listener at jenkins-hbase4.apache.org/42301] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@725ec8f4, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/local-export-1689790266138, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/local-export-1689790266138/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 18:11:20,327 INFO [Listener at jenkins-hbase4.apache.org/42301] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:40881, inputRoot=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf, snapshotDir=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-19 18:11:20,341 INFO [Listener at jenkins-hbase4.apache.org/42301] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/local-export-1689790266138/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 18:11:20,354 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 18:11:20,354 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 18:11:20,355 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 18:11:20,355 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 18:11:20,355 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-19 18:11:20,356 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 18:11:20,356 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 18:11:20,424 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/hadoop-6146285798733293620.jar 2023-07-19 18:11:20,424 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 18:11:20,425 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 18:11:20,425 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 18:11:20,425 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 18:11:20,426 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 18:11:20,426 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 18:11:20,426 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 18:11:20,427 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 18:11:20,427 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 18:11:20,428 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 18:11:20,428 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 18:11:20,428 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 18:11:20,429 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 18:11:20,429 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 18:11:20,429 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 18:11:20,430 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 18:11:20,430 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 18:11:20,430 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 18:11:20,431 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 18:11:20,431 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 18:11:20,431 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 18:11:20,432 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 18:11:20,432 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 18:11:20,797 WARN [Listener at jenkins-hbase4.apache.org/42301] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 18:11:20,799 INFO [Listener at jenkins-hbase4.apache.org/42301] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-19 18:11:20,802 DEBUG [Listener at jenkins-hbase4.apache.org/42301] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-19 18:11:24,520 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 18:11:24,521 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 18:11:24,524 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689790227140_0003_000001 (auth:SIMPLE) 2023-07-19 18:11:25,295 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689790227140_0004_000001 (auth:SIMPLE) 2023-07-19 18:11:29,681 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689790227140_0004_000001 (auth:SIMPLE) 2023-07-19 18:11:31,936 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689790227140_0004_000001 (auth:SIMPLE) 2023-07-19 18:11:35,071 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689790227140_0004_000001 (auth:SIMPLE) 2023-07-19 18:11:37,024 INFO [Listener at jenkins-hbase4.apache.org/42301] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 18:11:37,025 INFO [Listener at jenkins-hbase4.apache.org/42301] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 18:11:37,032 INFO [Listener at jenkins-hbase4.apache.org/42301] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-19 18:11:37,032 INFO [Listener at jenkins-hbase4.apache.org/42301] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 18:11:37,033 INFO [Listener at jenkins-hbase4.apache.org/42301] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 18:11:37,033 DEBUG [Listener at jenkins-hbase4.apache.org/42301] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2119224145_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-19 18:11:37,041 DEBUG [Listener at jenkins-hbase4.apache.org/42301] snapshot.TestExportSnapshot(367): hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-19 18:11:37,041 DEBUG [Listener at jenkins-hbase4.apache.org/42301] snapshot.TestExportSnapshot(367): hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-19 18:11:37,041 DEBUG [Listener at jenkins-hbase4.apache.org/42301] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@5798943b in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/local-export-1689790266138/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/local-export-1689790266138/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-19 18:11:37,042 DEBUG [Listener at jenkins-hbase4.apache.org/42301] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/local-export-1689790266138/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-19 18:11:37,042 DEBUG [Listener at jenkins-hbase4.apache.org/42301] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/local-export-1689790266138/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-19 18:11:37,059 INFO [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-19 18:11:37,060 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-19 18:11:37,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-19 18:11:37,067 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689790297067"}]},"ts":"1689790297067"} 2023-07-19 18:11:37,069 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-19 18:11:37,071 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-19 18:11:37,076 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5073c5d4bf2b04bbd2cbc4f5cdabc806, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8fa8eb7329c2dc3bd2a4dff0b8546256, UNASSIGN}] 2023-07-19 18:11:37,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-19 18:11:37,093 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5073c5d4bf2b04bbd2cbc4f5cdabc806, UNASSIGN 2023-07-19 18:11:37,093 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8fa8eb7329c2dc3bd2a4dff0b8546256, UNASSIGN 2023-07-19 18:11:37,095 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=5073c5d4bf2b04bbd2cbc4f5cdabc806, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:37,095 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=8fa8eb7329c2dc3bd2a4dff0b8546256, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:37,095 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689790264282.5073c5d4bf2b04bbd2cbc4f5cdabc806.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689790297095"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689790297095"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689790297095"}]},"ts":"1689790297095"} 2023-07-19 18:11:37,095 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689790264282.8fa8eb7329c2dc3bd2a4dff0b8546256.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689790297095"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689790297095"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689790297095"}]},"ts":"1689790297095"} 2023-07-19 18:11:37,098 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure 5073c5d4bf2b04bbd2cbc4f5cdabc806, server=jenkins-hbase4.apache.org,40317,1689790219525}] 2023-07-19 18:11:37,099 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure 8fa8eb7329c2dc3bd2a4dff0b8546256, server=jenkins-hbase4.apache.org,44407,1689790219668}] 2023-07-19 18:11:37,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-19 18:11:37,252 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5073c5d4bf2b04bbd2cbc4f5cdabc806 2023-07-19 18:11:37,252 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 8fa8eb7329c2dc3bd2a4dff0b8546256 2023-07-19 18:11:37,252 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5073c5d4bf2b04bbd2cbc4f5cdabc806, disabling compactions & flushes 2023-07-19 18:11:37,252 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8fa8eb7329c2dc3bd2a4dff0b8546256, disabling compactions & flushes 2023-07-19 18:11:37,252 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689790264282.5073c5d4bf2b04bbd2cbc4f5cdabc806. 2023-07-19 18:11:37,252 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689790264282.8fa8eb7329c2dc3bd2a4dff0b8546256. 2023-07-19 18:11:37,252 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689790264282.5073c5d4bf2b04bbd2cbc4f5cdabc806. 2023-07-19 18:11:37,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689790264282.8fa8eb7329c2dc3bd2a4dff0b8546256. 2023-07-19 18:11:37,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689790264282.5073c5d4bf2b04bbd2cbc4f5cdabc806. after waiting 0 ms 2023-07-19 18:11:37,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689790264282.8fa8eb7329c2dc3bd2a4dff0b8546256. after waiting 0 ms 2023-07-19 18:11:37,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689790264282.5073c5d4bf2b04bbd2cbc4f5cdabc806. 2023-07-19 18:11:37,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689790264282.8fa8eb7329c2dc3bd2a4dff0b8546256. 2023-07-19 18:11:37,275 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testConsecutiveExports/8fa8eb7329c2dc3bd2a4dff0b8546256/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 18:11:37,276 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 18:11:37,276 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testConsecutiveExports/5073c5d4bf2b04bbd2cbc4f5cdabc806/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 18:11:37,278 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689790264282.8fa8eb7329c2dc3bd2a4dff0b8546256. 2023-07-19 18:11:37,278 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8fa8eb7329c2dc3bd2a4dff0b8546256: 2023-07-19 18:11:37,278 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 18:11:37,279 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689790264282.5073c5d4bf2b04bbd2cbc4f5cdabc806. 2023-07-19 18:11:37,279 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5073c5d4bf2b04bbd2cbc4f5cdabc806: 2023-07-19 18:11:37,281 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 8fa8eb7329c2dc3bd2a4dff0b8546256 2023-07-19 18:11:37,282 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=8fa8eb7329c2dc3bd2a4dff0b8546256, regionState=CLOSED 2023-07-19 18:11:37,282 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689790264282.8fa8eb7329c2dc3bd2a4dff0b8546256.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689790297281"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689790297281"}]},"ts":"1689790297281"} 2023-07-19 18:11:37,282 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5073c5d4bf2b04bbd2cbc4f5cdabc806 2023-07-19 18:11:37,283 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=5073c5d4bf2b04bbd2cbc4f5cdabc806, regionState=CLOSED 2023-07-19 18:11:37,283 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689790264282.5073c5d4bf2b04bbd2cbc4f5cdabc806.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689790297283"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689790297283"}]},"ts":"1689790297283"} 2023-07-19 18:11:37,291 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=53 2023-07-19 18:11:37,291 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=52 2023-07-19 18:11:37,291 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure 5073c5d4bf2b04bbd2cbc4f5cdabc806, server=jenkins-hbase4.apache.org,40317,1689790219525 in 187 msec 2023-07-19 18:11:37,291 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure 8fa8eb7329c2dc3bd2a4dff0b8546256, server=jenkins-hbase4.apache.org,44407,1689790219668 in 185 msec 2023-07-19 18:11:37,301 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5073c5d4bf2b04bbd2cbc4f5cdabc806, UNASSIGN in 215 msec 2023-07-19 18:11:37,302 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-07-19 18:11:37,302 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8fa8eb7329c2dc3bd2a4dff0b8546256, UNASSIGN in 215 msec 2023-07-19 18:11:37,303 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689790297303"}]},"ts":"1689790297303"} 2023-07-19 18:11:37,305 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-19 18:11:37,308 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-19 18:11:37,310 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 249 msec 2023-07-19 18:11:37,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-19 18:11:37,381 INFO [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-19 18:11:37,382 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-19 18:11:37,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-19 18:11:37,387 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-19 18:11:37,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-19 18:11:37,388 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-19 18:11:37,394 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33037] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-19 18:11:37,398 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 18:11:37,398 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 18:11:37,398 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 18:11:37,398 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 18:11:37,399 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-19 18:11:37,399 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-19 18:11:37,399 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-19 18:11:37,400 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-19 18:11:37,400 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testConsecutiveExports/5073c5d4bf2b04bbd2cbc4f5cdabc806 2023-07-19 18:11:37,400 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testConsecutiveExports/8fa8eb7329c2dc3bd2a4dff0b8546256 2023-07-19 18:11:37,401 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 18:11:37,401 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 18:11:37,401 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 18:11:37,401 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 18:11:37,401 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 18:11:37,401 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 18:11:37,401 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 18:11:37,402 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 18:11:37,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-19 18:11:37,404 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testConsecutiveExports/8fa8eb7329c2dc3bd2a4dff0b8546256/cf, FileablePath, hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testConsecutiveExports/8fa8eb7329c2dc3bd2a4dff0b8546256/recovered.edits] 2023-07-19 18:11:37,404 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testConsecutiveExports/5073c5d4bf2b04bbd2cbc4f5cdabc806/cf, FileablePath, hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testConsecutiveExports/5073c5d4bf2b04bbd2cbc4f5cdabc806/recovered.edits] 2023-07-19 18:11:37,412 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testConsecutiveExports/5073c5d4bf2b04bbd2cbc4f5cdabc806/cf/f04e2d8263e14a9984021325b8e2b497 to hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/archive/data/default/testtb-testConsecutiveExports/5073c5d4bf2b04bbd2cbc4f5cdabc806/cf/f04e2d8263e14a9984021325b8e2b497 2023-07-19 18:11:37,412 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testConsecutiveExports/8fa8eb7329c2dc3bd2a4dff0b8546256/cf/977e91c5ca984984873d51dba2b47cd8 to hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/archive/data/default/testtb-testConsecutiveExports/8fa8eb7329c2dc3bd2a4dff0b8546256/cf/977e91c5ca984984873d51dba2b47cd8 2023-07-19 18:11:37,418 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testConsecutiveExports/5073c5d4bf2b04bbd2cbc4f5cdabc806/recovered.edits/9.seqid to hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/archive/data/default/testtb-testConsecutiveExports/5073c5d4bf2b04bbd2cbc4f5cdabc806/recovered.edits/9.seqid 2023-07-19 18:11:37,420 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testConsecutiveExports/5073c5d4bf2b04bbd2cbc4f5cdabc806 2023-07-19 18:11:37,420 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testConsecutiveExports/8fa8eb7329c2dc3bd2a4dff0b8546256/recovered.edits/9.seqid to hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/archive/data/default/testtb-testConsecutiveExports/8fa8eb7329c2dc3bd2a4dff0b8546256/recovered.edits/9.seqid 2023-07-19 18:11:37,426 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testConsecutiveExports/8fa8eb7329c2dc3bd2a4dff0b8546256 2023-07-19 18:11:37,426 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-19 18:11:37,429 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-19 18:11:37,433 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-19 18:11:37,441 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-19 18:11:37,446 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-19 18:11:37,446 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-19 18:11:37,446 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689790264282.5073c5d4bf2b04bbd2cbc4f5cdabc806.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689790297446"}]},"ts":"9223372036854775807"} 2023-07-19 18:11:37,446 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689790264282.8fa8eb7329c2dc3bd2a4dff0b8546256.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689790297446"}]},"ts":"9223372036854775807"} 2023-07-19 18:11:37,449 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-19 18:11:37,449 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 5073c5d4bf2b04bbd2cbc4f5cdabc806, NAME => 'testtb-testConsecutiveExports,,1689790264282.5073c5d4bf2b04bbd2cbc4f5cdabc806.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 8fa8eb7329c2dc3bd2a4dff0b8546256, NAME => 'testtb-testConsecutiveExports,1,1689790264282.8fa8eb7329c2dc3bd2a4dff0b8546256.', STARTKEY => '1', ENDKEY => ''}] 2023-07-19 18:11:37,449 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-19 18:11:37,449 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689790297449"}]},"ts":"9223372036854775807"} 2023-07-19 18:11:37,452 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-19 18:11:37,454 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-19 18:11:37,456 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 72 msec 2023-07-19 18:11:37,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-19 18:11:37,504 INFO [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-19 18:11:37,516 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-19 18:11:37,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-19 18:11:37,520 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-19 18:11:37,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-19 18:11:37,562 INFO [Listener at jenkins-hbase4.apache.org/42301] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=749 (was 768), OpenFileDescriptor=894 (was 922), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=444 (was 365) - SystemLoadAverage LEAK? -, ProcessCount=184 (was 183) - ProcessCount LEAK? -, AvailableMemoryMB=2907 (was 3031) 2023-07-19 18:11:37,562 WARN [Listener at jenkins-hbase4.apache.org/42301] hbase.ResourceChecker(130): Thread=749 is superior to 500 2023-07-19 18:11:37,590 INFO [Listener at jenkins-hbase4.apache.org/42301] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=749, OpenFileDescriptor=894, MaxFileDescriptor=60000, SystemLoadAverage=444, ProcessCount=184, AvailableMemoryMB=2901 2023-07-19 18:11:37,590 WARN [Listener at jenkins-hbase4.apache.org/42301] hbase.ResourceChecker(130): Thread=749 is superior to 500 2023-07-19 18:11:37,592 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-19 18:11:37,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:37,596 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 18:11:37,596 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-19 18:11:37,597 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 18:11:37,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-19 18:11:37,600 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/018416be9de25ae12dd96a74f0a674a7 2023-07-19 18:11:37,600 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1e449696eaee28dc66406af52c4f95a5 2023-07-19 18:11:37,601 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/018416be9de25ae12dd96a74f0a674a7 empty. 2023-07-19 18:11:37,601 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1e449696eaee28dc66406af52c4f95a5 empty. 2023-07-19 18:11:37,601 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/018416be9de25ae12dd96a74f0a674a7 2023-07-19 18:11:37,601 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1e449696eaee28dc66406af52c4f95a5 2023-07-19 18:11:37,601 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-19 18:11:37,626 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-19 18:11:37,629 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 1e449696eaee28dc66406af52c4f95a5, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689790297592.1e449696eaee28dc66406af52c4f95a5.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp 2023-07-19 18:11:37,629 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 018416be9de25ae12dd96a74f0a674a7, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689790297592.018416be9de25ae12dd96a74f0a674a7.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp 2023-07-19 18:11:37,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-19 18:11:37,718 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689790297592.018416be9de25ae12dd96a74f0a674a7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 18:11:37,718 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 018416be9de25ae12dd96a74f0a674a7, disabling compactions & flushes 2023-07-19 18:11:37,718 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689790297592.018416be9de25ae12dd96a74f0a674a7. 2023-07-19 18:11:37,718 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689790297592.018416be9de25ae12dd96a74f0a674a7. 2023-07-19 18:11:37,718 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689790297592.1e449696eaee28dc66406af52c4f95a5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 18:11:37,718 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 1e449696eaee28dc66406af52c4f95a5, disabling compactions & flushes 2023-07-19 18:11:37,718 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689790297592.018416be9de25ae12dd96a74f0a674a7. after waiting 0 ms 2023-07-19 18:11:37,719 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689790297592.1e449696eaee28dc66406af52c4f95a5. 2023-07-19 18:11:37,719 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689790297592.018416be9de25ae12dd96a74f0a674a7. 2023-07-19 18:11:37,719 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689790297592.1e449696eaee28dc66406af52c4f95a5. 2023-07-19 18:11:37,719 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689790297592.018416be9de25ae12dd96a74f0a674a7. 2023-07-19 18:11:37,719 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689790297592.1e449696eaee28dc66406af52c4f95a5. after waiting 0 ms 2023-07-19 18:11:37,719 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 018416be9de25ae12dd96a74f0a674a7: 2023-07-19 18:11:37,719 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689790297592.1e449696eaee28dc66406af52c4f95a5. 2023-07-19 18:11:37,719 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689790297592.1e449696eaee28dc66406af52c4f95a5. 2023-07-19 18:11:37,719 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 1e449696eaee28dc66406af52c4f95a5: 2023-07-19 18:11:37,725 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 18:11:37,740 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689790297592.018416be9de25ae12dd96a74f0a674a7.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689790297740"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689790297740"}]},"ts":"1689790297740"} 2023-07-19 18:11:37,740 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689790297592.1e449696eaee28dc66406af52c4f95a5.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689790297740"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689790297740"}]},"ts":"1689790297740"} 2023-07-19 18:11:37,762 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 18:11:37,763 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 18:11:37,764 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689790297763"}]},"ts":"1689790297763"} 2023-07-19 18:11:37,766 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-19 18:11:37,771 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 18:11:37,773 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 18:11:37,773 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 18:11:37,773 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 18:11:37,773 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 18:11:37,773 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=018416be9de25ae12dd96a74f0a674a7, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1e449696eaee28dc66406af52c4f95a5, ASSIGN}] 2023-07-19 18:11:37,778 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1e449696eaee28dc66406af52c4f95a5, ASSIGN 2023-07-19 18:11:37,778 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=018416be9de25ae12dd96a74f0a674a7, ASSIGN 2023-07-19 18:11:37,784 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1e449696eaee28dc66406af52c4f95a5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40317,1689790219525; forceNewPlan=false, retain=false 2023-07-19 18:11:37,784 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=018416be9de25ae12dd96a74f0a674a7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33037,1689790219604; forceNewPlan=false, retain=false 2023-07-19 18:11:37,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-19 18:11:37,934 INFO [jenkins-hbase4:40453] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 18:11:37,938 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=1e449696eaee28dc66406af52c4f95a5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:37,938 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=018416be9de25ae12dd96a74f0a674a7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:37,938 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689790297592.1e449696eaee28dc66406af52c4f95a5.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689790297938"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689790297938"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689790297938"}]},"ts":"1689790297938"} 2023-07-19 18:11:37,938 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689790297592.018416be9de25ae12dd96a74f0a674a7.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689790297938"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689790297938"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689790297938"}]},"ts":"1689790297938"} 2023-07-19 18:11:37,942 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure 1e449696eaee28dc66406af52c4f95a5, server=jenkins-hbase4.apache.org,40317,1689790219525}] 2023-07-19 18:11:37,943 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure 018416be9de25ae12dd96a74f0a674a7, server=jenkins-hbase4.apache.org,33037,1689790219604}] 2023-07-19 18:11:38,098 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689790297592.1e449696eaee28dc66406af52c4f95a5. 2023-07-19 18:11:38,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1e449696eaee28dc66406af52c4f95a5, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689790297592.1e449696eaee28dc66406af52c4f95a5.', STARTKEY => '1', ENDKEY => ''} 2023-07-19 18:11:38,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689790297592.1e449696eaee28dc66406af52c4f95a5. service=AccessControlService 2023-07-19 18:11:38,099 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 18:11:38,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 1e449696eaee28dc66406af52c4f95a5 2023-07-19 18:11:38,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689790297592.1e449696eaee28dc66406af52c4f95a5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 18:11:38,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1e449696eaee28dc66406af52c4f95a5 2023-07-19 18:11:38,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1e449696eaee28dc66406af52c4f95a5 2023-07-19 18:11:38,101 INFO [StoreOpener-1e449696eaee28dc66406af52c4f95a5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 1e449696eaee28dc66406af52c4f95a5 2023-07-19 18:11:38,107 DEBUG [StoreOpener-1e449696eaee28dc66406af52c4f95a5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithMergeRegion/1e449696eaee28dc66406af52c4f95a5/cf 2023-07-19 18:11:38,107 DEBUG [StoreOpener-1e449696eaee28dc66406af52c4f95a5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithMergeRegion/1e449696eaee28dc66406af52c4f95a5/cf 2023-07-19 18:11:38,109 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689790297592.018416be9de25ae12dd96a74f0a674a7. 2023-07-19 18:11:38,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 018416be9de25ae12dd96a74f0a674a7, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689790297592.018416be9de25ae12dd96a74f0a674a7.', STARTKEY => '', ENDKEY => '1'} 2023-07-19 18:11:38,109 INFO [StoreOpener-1e449696eaee28dc66406af52c4f95a5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1e449696eaee28dc66406af52c4f95a5 columnFamilyName cf 2023-07-19 18:11:38,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689790297592.018416be9de25ae12dd96a74f0a674a7. service=AccessControlService 2023-07-19 18:11:38,109 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 18:11:38,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 018416be9de25ae12dd96a74f0a674a7 2023-07-19 18:11:38,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689790297592.018416be9de25ae12dd96a74f0a674a7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 18:11:38,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 018416be9de25ae12dd96a74f0a674a7 2023-07-19 18:11:38,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 018416be9de25ae12dd96a74f0a674a7 2023-07-19 18:11:38,111 INFO [StoreOpener-1e449696eaee28dc66406af52c4f95a5-1] regionserver.HStore(310): Store=1e449696eaee28dc66406af52c4f95a5/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 18:11:38,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithMergeRegion/1e449696eaee28dc66406af52c4f95a5 2023-07-19 18:11:38,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithMergeRegion/1e449696eaee28dc66406af52c4f95a5 2023-07-19 18:11:38,124 INFO [StoreOpener-018416be9de25ae12dd96a74f0a674a7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 018416be9de25ae12dd96a74f0a674a7 2023-07-19 18:11:38,126 DEBUG [StoreOpener-018416be9de25ae12dd96a74f0a674a7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithMergeRegion/018416be9de25ae12dd96a74f0a674a7/cf 2023-07-19 18:11:38,127 DEBUG [StoreOpener-018416be9de25ae12dd96a74f0a674a7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithMergeRegion/018416be9de25ae12dd96a74f0a674a7/cf 2023-07-19 18:11:38,128 INFO [StoreOpener-018416be9de25ae12dd96a74f0a674a7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 018416be9de25ae12dd96a74f0a674a7 columnFamilyName cf 2023-07-19 18:11:38,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1e449696eaee28dc66406af52c4f95a5 2023-07-19 18:11:38,131 INFO [StoreOpener-018416be9de25ae12dd96a74f0a674a7-1] regionserver.HStore(310): Store=018416be9de25ae12dd96a74f0a674a7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 18:11:38,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithMergeRegion/018416be9de25ae12dd96a74f0a674a7 2023-07-19 18:11:38,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithMergeRegion/018416be9de25ae12dd96a74f0a674a7 2023-07-19 18:11:38,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithMergeRegion/1e449696eaee28dc66406af52c4f95a5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 18:11:38,142 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1e449696eaee28dc66406af52c4f95a5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73456232, jitterRate=0.09458315372467041}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 18:11:38,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1e449696eaee28dc66406af52c4f95a5: 2023-07-19 18:11:38,145 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689790297592.1e449696eaee28dc66406af52c4f95a5., pid=60, masterSystemTime=1689790298094 2023-07-19 18:11:38,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689790297592.1e449696eaee28dc66406af52c4f95a5. 2023-07-19 18:11:38,148 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689790297592.1e449696eaee28dc66406af52c4f95a5. 2023-07-19 18:11:38,149 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=1e449696eaee28dc66406af52c4f95a5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:38,149 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689790297592.1e449696eaee28dc66406af52c4f95a5.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689790298149"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689790298149"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689790298149"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689790298149"}]},"ts":"1689790298149"} 2023-07-19 18:11:38,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 018416be9de25ae12dd96a74f0a674a7 2023-07-19 18:11:38,155 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-07-19 18:11:38,155 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure 1e449696eaee28dc66406af52c4f95a5, server=jenkins-hbase4.apache.org,40317,1689790219525 in 209 msec 2023-07-19 18:11:38,157 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1e449696eaee28dc66406af52c4f95a5, ASSIGN in 382 msec 2023-07-19 18:11:38,168 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithMergeRegion/018416be9de25ae12dd96a74f0a674a7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 18:11:38,168 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 018416be9de25ae12dd96a74f0a674a7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67428447, jitterRate=0.0047621577978134155}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 18:11:38,168 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 018416be9de25ae12dd96a74f0a674a7: 2023-07-19 18:11:38,169 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689790297592.018416be9de25ae12dd96a74f0a674a7., pid=61, masterSystemTime=1689790298100 2023-07-19 18:11:38,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689790297592.018416be9de25ae12dd96a74f0a674a7. 2023-07-19 18:11:38,171 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689790297592.018416be9de25ae12dd96a74f0a674a7. 2023-07-19 18:11:38,172 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=018416be9de25ae12dd96a74f0a674a7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:38,172 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689790297592.018416be9de25ae12dd96a74f0a674a7.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689790298172"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689790298172"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689790298172"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689790298172"}]},"ts":"1689790298172"} 2023-07-19 18:11:38,183 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=58 2023-07-19 18:11:38,183 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure 018416be9de25ae12dd96a74f0a674a7, server=jenkins-hbase4.apache.org,33037,1689790219604 in 231 msec 2023-07-19 18:11:38,189 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=58, resume processing ppid=57 2023-07-19 18:11:38,189 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=018416be9de25ae12dd96a74f0a674a7, ASSIGN in 410 msec 2023-07-19 18:11:38,190 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 18:11:38,190 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689790298190"}]},"ts":"1689790298190"} 2023-07-19 18:11:38,194 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-19 18:11:38,201 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 18:11:38,202 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-19 18:11:38,205 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33037] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-19 18:11:38,206 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 18:11:38,207 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 18:11:38,207 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 18:11:38,207 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 18:11:38,209 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 18:11:38,209 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 18:11:38,209 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 18:11:38,209 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 18:11:38,213 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 617 msec 2023-07-19 18:11:38,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-19 18:11:38,216 INFO [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-19 18:11:38,216 DEBUG [Listener at jenkins-hbase4.apache.org/42301] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithMergeRegion get assigned. Timeout = 60000ms 2023-07-19 18:11:38,217 INFO [Listener at jenkins-hbase4.apache.org/42301] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 18:11:38,227 INFO [Listener at jenkins-hbase4.apache.org/42301] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned to meta. Checking AM states. 2023-07-19 18:11:38,227 INFO [Listener at jenkins-hbase4.apache.org/42301] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 18:11:38,227 INFO [Listener at jenkins-hbase4.apache.org/42301] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned. 2023-07-19 18:11:38,234 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-19 18:11:38,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689790298234 (current time:1689790298234). 2023-07-19 18:11:38,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 18:11:38,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] zookeeper.ReadOnlyZKClient(139): Connect 0x3ea10b93 to 127.0.0.1:51604 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 18:11:38,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5d565592, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 18:11:38,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 18:11:38,254 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52984, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 18:11:38,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3ea10b93 to 127.0.0.1:51604 2023-07-19 18:11:38,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 18:11:38,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] zookeeper.ReadOnlyZKClient(139): Connect 0x699b134b to 127.0.0.1:51604 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 18:11:38,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5f507078, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 18:11:38,267 DEBUG [hconnection-0x30c544c5-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 18:11:38,271 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52998, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 18:11:38,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x699b134b to 127.0.0.1:51604 2023-07-19 18:11:38,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 18:11:38,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-19 18:11:38,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 18:11:38,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-19 18:11:38,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-19 18:11:38,283 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-19 18:11:38,284 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689790898284 2023-07-19 18:11:38,284 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:38,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-19 18:11:38,286 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 18:11:38,287 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 18:11:38,287 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-19 18:11:38,288 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-19 18:11:38,290 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 7 msec 2023-07-19 18:11:38,291 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-19 18:11:38,291 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689790898291 2023-07-19 18:11:38,329 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:38,329 INFO [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-19 18:11:38,329 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 18:11:38,331 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-19 18:11:38,331 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-19 18:11:38,382 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:38,383 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:38,385 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:11:38,386 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:11:38,386 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:11:38,385 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:38,385 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:11:38,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:11:38,386 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:11:38,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:11:38,386 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:11:38,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:11:38,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:38,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:38,387 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 18:11:38,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:38,388 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:38,388 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:38,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-19 18:11:38,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-19 18:11:38,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-19 18:11:38,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:38,389 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 18:11:38,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-19 18:11:38,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:38,389 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-19 18:11:38,388 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:38,389 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-19 18:11:38,389 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:38,390 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:38,390 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:38,390 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-19 18:11:38,390 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:38,390 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 18:11:38,390 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-19 18:11:38,393 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 18:11:38,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-19 18:11:38,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:38,394 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-19 18:11:38,398 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-19 18:11:38,398 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-19 18:11:38,398 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44407,1689790219668' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-19 18:11:38,400 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:38,401 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:38,401 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 18:11:38,409 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:38,409 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-19 18:11:38,409 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 18:11:38,410 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:38,410 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 18:11:38,415 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-19 18:11:38,415 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-19 18:11:38,415 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40317,1689790219525' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-19 18:11:38,415 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-19 18:11:38,415 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-19 18:11:38,415 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33037,1689790219604' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-19 18:11:38,417 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:38,417 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:38,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:38,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 18:11:38,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 18:11:38,418 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:38,418 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 18:11:38,418 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:38,418 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:38,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 18:11:38,419 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:38,419 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 18:11:38,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 18:11:38,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:38,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:38,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:38,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:38,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 18:11:38,423 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40317,1689790219525' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-19 18:11:38,423 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@47386e08[Count = 1] remaining members to acquire global barrier 2023-07-19 18:11:38,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:38,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 18:11:38,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 18:11:38,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 18:11:38,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 18:11:38,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:38,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:38,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:38,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:38,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 18:11:38,426 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33037,1689790219604' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-19 18:11:38,426 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@47386e08[Count = 0] remaining members to acquire global barrier 2023-07-19 18:11:38,426 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-19 18:11:38,426 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:38,430 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:38,430 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:38,431 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:38,431 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:38,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:38,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:38,431 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-19 18:11:38,431 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-19 18:11:38,430 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:38,431 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:38,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:38,431 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-19 18:11:38,431 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-19 18:11:38,431 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,44407,1689790219668' in zk 2023-07-19 18:11:38,431 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:38,432 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 18:11:38,432 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 18:11:38,433 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689790297592.018416be9de25ae12dd96a74f0a674a7. 2023-07-19 18:11:38,433 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689790297592.018416be9de25ae12dd96a74f0a674a7. started... 2023-07-19 18:11:38,436 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 18:11:38,436 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 018416be9de25ae12dd96a74f0a674a7: 2023-07-19 18:11:38,436 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 18:11:38,436 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689790297592.1e449696eaee28dc66406af52c4f95a5. 2023-07-19 18:11:38,436 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689790297592.1e449696eaee28dc66406af52c4f95a5. started... 2023-07-19 18:11:38,436 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689790297592.018416be9de25ae12dd96a74f0a674a7.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:38,436 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 18:11:38,438 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1e449696eaee28dc66406af52c4f95a5: 2023-07-19 18:11:38,439 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 18:11:38,440 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689790297592.1e449696eaee28dc66406af52c4f95a5.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:38,440 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 18:11:38,440 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 18:11:38,441 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-19 18:11:38,441 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 18:11:38,441 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-19 18:11:38,441 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:38,444 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 18:11:38,518 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689790297592.1e449696eaee28dc66406af52c4f95a5. completed. 2023-07-19 18:11:38,518 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689790297592.1e449696eaee28dc66406af52c4f95a5. 2023-07-19 18:11:38,519 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 18:11:38,519 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 18:11:38,519 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:38,519 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-19 18:11:38,519 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,40317,1689790219525' in zk 2023-07-19 18:11:38,521 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-19 18:11:38,521 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:38,521 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 18:11:38,521 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-19 18:11:38,521 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689790297592.018416be9de25ae12dd96a74f0a674a7. completed. 2023-07-19 18:11:38,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:38,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 18:11:38,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 18:11:38,522 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689790297592.018416be9de25ae12dd96a74f0a674a7. 2023-07-19 18:11:38,523 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 18:11:38,523 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 18:11:38,523 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:38,523 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-19 18:11:38,523 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,33037,1689790219604' in zk 2023-07-19 18:11:38,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 18:11:38,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 18:11:38,526 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-19 18:11:38,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:38,526 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:38,526 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 18:11:38,526 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-19 18:11:38,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:38,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:38,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:38,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 18:11:38,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:38,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:38,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:38,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:38,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,40317,1689790219525': 2023-07-19 18:11:38,550 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40317,1689790219525' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-19 18:11:38,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:38,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 18:11:38,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 18:11:38,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 18:11:38,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 18:11:38,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:38,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:38,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:38,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:38,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 18:11:38,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:38,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:38,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:38,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:38,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,33037,1689790219604': 2023-07-19 18:11:38,555 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33037,1689790219604' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-19 18:11:38,555 INFO [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-19 18:11:38,555 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 18:11:38,555 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 18:11:38,555 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:38,555 INFO [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 18:11:38,557 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:38,557 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:38,557 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:38,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:38,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:38,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:38,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:38,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 18:11:38,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 18:11:38,557 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:11:38,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:38,557 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:11:38,557 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:38,558 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:11:38,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:38,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:38,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:11:38,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:11:38,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:11:38,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:11:38,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 18:11:38,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:11:38,558 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:38,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:11:38,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:38,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:38,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:38,559 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:38,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:38,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 18:11:38,560 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:38,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:38,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:38,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:38,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:38,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 18:11:38,562 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:38,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:38,562 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:38,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:38,563 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:38,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:38,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:38,566 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:11:38,566 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:11:38,566 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:11:38,566 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:11:38,566 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:11:38,567 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:38,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:11:38,567 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:38,566 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:11:38,567 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:11:38,566 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:38,566 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:11:38,567 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:38,566 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 18:11:38,567 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:38,567 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:38,569 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:38,569 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:38,569 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:38,569 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:38,569 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:38,569 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:38,569 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:38,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:11:38,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:11:38,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:11:38,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:11:38,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:11:38,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:11:38,570 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:38,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:11:38,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:11:38,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:11:38,589 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 18:11:38,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-19 18:11:38,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-19 18:11:38,590 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 18:11:38,615 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:38,650 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-19 18:11:38,650 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:38,651 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:38,651 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689790298285Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689790298567 (+282 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689790298567Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689790298586 (+19 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689790298603 (+17 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689790298650 (+47 ms) 2023-07-19 18:11:38,654 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-19 18:11:38,656 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 368 msec 2023-07-19 18:11:38,891 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 18:11:38,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-19 18:11:38,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 18:11:38,916 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33037] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689790297592.018416be9de25ae12dd96a74f0a674a7. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 18:11:38,917 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40317] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689790297592.1e449696eaee28dc66406af52c4f95a5. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 18:11:38,925 DEBUG [Listener at jenkins-hbase4.apache.org/42301] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:38,925 DEBUG [Listener at jenkins-hbase4.apache.org/42301] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689790297592.018416be9de25ae12dd96a74f0a674a7. 2023-07-19 18:11:38,926 INFO [Listener at jenkins-hbase4.apache.org/42301] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 18:11:38,944 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-19 18:11:38,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689790298944 (current time:1689790298944). 2023-07-19 18:11:38,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 18:11:38,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] zookeeper.ReadOnlyZKClient(139): Connect 0x6d7efc18 to 127.0.0.1:51604 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 18:11:38,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@358b66b2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 18:11:38,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 18:11:38,961 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53000, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 18:11:38,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6d7efc18 to 127.0.0.1:51604 2023-07-19 18:11:38,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 18:11:38,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] zookeeper.ReadOnlyZKClient(139): Connect 0x66c286f2 to 127.0.0.1:51604 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 18:11:38,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3f1b0f6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 18:11:38,977 DEBUG [hconnection-0x223827b5-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 18:11:38,981 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53002, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 18:11:38,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x66c286f2 to 127.0.0.1:51604 2023-07-19 18:11:38,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 18:11:38,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-19 18:11:38,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 18:11:38,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-19 18:11:38,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-19 18:11:38,996 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-19 18:11:38,997 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689790898997 2023-07-19 18:11:38,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-19 18:11:38,998 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:38,998 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 18:11:38,999 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 18:11:39,001 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-19 18:11:39,003 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-19 18:11:39,019 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 9 msec 2023-07-19 18:11:39,029 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-19 18:11:39,036 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689790899036 2023-07-19 18:11:39,099 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 18:11:39,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-19 18:11:39,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-19 18:11:39,106 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 18:11:39,106 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:39,106 INFO [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-19 18:11:39,106 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 18:11:39,106 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-19 18:11:39,107 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-19 18:11:39,107 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:39,107 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:39,109 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:11:39,109 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:11:39,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:11:39,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:11:39,109 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:11:39,109 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:39,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:11:39,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:11:39,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:11:39,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:11:39,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:39,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:39,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:39,110 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:39,110 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:39,110 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:39,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-19 18:11:39,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:39,110 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:39,111 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-19 18:11:39,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-19 18:11:39,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:39,112 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-19 18:11:39,112 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:39,112 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:39,112 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 18:11:39,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-19 18:11:39,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:39,112 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-19 18:11:39,117 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:39,117 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-19 18:11:39,117 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 18:11:39,120 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:39,122 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:39,122 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-19 18:11:39,122 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-19 18:11:39,122 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-19 18:11:39,123 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 18:11:39,122 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-19 18:11:39,124 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40317,1689790219525' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-19 18:11:39,122 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 18:11:39,126 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-19 18:11:39,126 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-19 18:11:39,126 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-19 18:11:39,126 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44407,1689790219668' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-19 18:11:39,126 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-19 18:11:39,126 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33037,1689790219604' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-19 18:11:39,128 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:39,129 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:39,129 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:39,129 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:39,129 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 18:11:39,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:39,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 18:11:39,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 18:11:39,131 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:39,131 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 18:11:39,131 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:39,132 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:39,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 18:11:39,132 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:39,132 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 18:11:39,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 18:11:39,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:39,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:39,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:39,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:39,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 18:11:39,134 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33037,1689790219604' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-19 18:11:39,134 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6f3d88e4[Count = 1] remaining members to acquire global barrier 2023-07-19 18:11:39,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:39,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 18:11:39,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 18:11:39,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 18:11:39,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 18:11:39,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:39,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:39,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:39,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:39,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 18:11:39,137 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40317,1689790219525' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-19 18:11:39,137 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6f3d88e4[Count = 0] remaining members to acquire global barrier 2023-07-19 18:11:39,137 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-19 18:11:39,137 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:39,139 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:39,139 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:39,139 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:39,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:39,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:39,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:39,139 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-19 18:11:39,139 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-19 18:11:39,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:39,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:39,139 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-19 18:11:39,139 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:39,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:39,139 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,44407,1689790219668' in zk 2023-07-19 18:11:39,140 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-19 18:11:39,140 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 18:11:39,140 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 18:11:39,140 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 18:11:39,140 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 18:11:39,140 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689790297592.1e449696eaee28dc66406af52c4f95a5. 2023-07-19 18:11:39,140 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:39,140 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689790297592.1e449696eaee28dc66406af52c4f95a5. started... 2023-07-19 18:11:39,140 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 18:11:39,140 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689790297592.018416be9de25ae12dd96a74f0a674a7. 2023-07-19 18:11:39,140 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689790297592.018416be9de25ae12dd96a74f0a674a7. started... 2023-07-19 18:11:39,140 INFO [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 1e449696eaee28dc66406af52c4f95a5 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-19 18:11:39,140 INFO [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 018416be9de25ae12dd96a74f0a674a7 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-19 18:11:39,142 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-19 18:11:39,142 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 18:11:39,142 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-19 18:11:39,169 INFO [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=266 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithMergeRegion/018416be9de25ae12dd96a74f0a674a7/.tmp/cf/0c246c47e3cf40ad9175555242a62579 2023-07-19 18:11:39,169 INFO [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.00 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithMergeRegion/1e449696eaee28dc66406af52c4f95a5/.tmp/cf/1b1fa345e24e4f1796f10f5b9fafddce 2023-07-19 18:11:39,183 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithMergeRegion/018416be9de25ae12dd96a74f0a674a7/.tmp/cf/0c246c47e3cf40ad9175555242a62579 as hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithMergeRegion/018416be9de25ae12dd96a74f0a674a7/cf/0c246c47e3cf40ad9175555242a62579 2023-07-19 18:11:39,185 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithMergeRegion/1e449696eaee28dc66406af52c4f95a5/.tmp/cf/1b1fa345e24e4f1796f10f5b9fafddce as hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithMergeRegion/1e449696eaee28dc66406af52c4f95a5/cf/1b1fa345e24e4f1796f10f5b9fafddce 2023-07-19 18:11:39,192 INFO [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithMergeRegion/018416be9de25ae12dd96a74f0a674a7/cf/0c246c47e3cf40ad9175555242a62579, entries=4, sequenceid=6, filesize=5.1 K 2023-07-19 18:11:39,193 INFO [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 018416be9de25ae12dd96a74f0a674a7 in 53ms, sequenceid=6, compaction requested=false 2023-07-19 18:11:39,194 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-19 18:11:39,194 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 018416be9de25ae12dd96a74f0a674a7: 2023-07-19 18:11:39,195 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689790297592.018416be9de25ae12dd96a74f0a674a7.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:39,195 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 18:11:39,195 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithMergeRegion/018416be9de25ae12dd96a74f0a674a7/cf/0c246c47e3cf40ad9175555242a62579] hfiles 2023-07-19 18:11:39,195 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithMergeRegion/018416be9de25ae12dd96a74f0a674a7/cf/0c246c47e3cf40ad9175555242a62579 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:39,198 INFO [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithMergeRegion/1e449696eaee28dc66406af52c4f95a5/cf/1b1fa345e24e4f1796f10f5b9fafddce, entries=46, sequenceid=6, filesize=7.9 K 2023-07-19 18:11:39,199 INFO [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 1e449696eaee28dc66406af52c4f95a5 in 59ms, sequenceid=6, compaction requested=false 2023-07-19 18:11:39,201 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1e449696eaee28dc66406af52c4f95a5: 2023-07-19 18:11:39,201 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689790297592.1e449696eaee28dc66406af52c4f95a5.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:39,202 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 18:11:39,202 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithMergeRegion/1e449696eaee28dc66406af52c4f95a5/cf/1b1fa345e24e4f1796f10f5b9fafddce] hfiles 2023-07-19 18:11:39,202 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithMergeRegion/1e449696eaee28dc66406af52c4f95a5/cf/1b1fa345e24e4f1796f10f5b9fafddce for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:39,211 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689790297592.018416be9de25ae12dd96a74f0a674a7. completed. 2023-07-19 18:11:39,211 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689790297592.018416be9de25ae12dd96a74f0a674a7. 2023-07-19 18:11:39,211 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 18:11:39,211 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 18:11:39,211 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:39,211 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-19 18:11:39,211 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,33037,1689790219604' in zk 2023-07-19 18:11:39,213 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:39,213 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-19 18:11:39,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:39,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 18:11:39,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 18:11:39,213 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 18:11:39,213 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-19 18:11:39,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 18:11:39,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 18:11:39,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:39,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:39,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:39,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:39,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 18:11:39,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:39,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:39,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:39,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,33037,1689790219604': 2023-07-19 18:11:39,225 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33037,1689790219604' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-19 18:11:39,306 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 18:11:39,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-19 18:11:39,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-19 18:11:39,309 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 18:11:39,609 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 18:11:39,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-19 18:11:39,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-19 18:11:39,611 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-19 18:11:39,622 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689790297592.1e449696eaee28dc66406af52c4f95a5. completed. 2023-07-19 18:11:39,622 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689790297592.1e449696eaee28dc66406af52c4f95a5. 2023-07-19 18:11:39,623 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 18:11:39,623 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 18:11:39,623 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:39,623 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-19 18:11:39,623 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,40317,1689790219525' in zk 2023-07-19 18:11:39,625 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:39,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:39,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 18:11:39,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 18:11:39,625 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-19 18:11:39,626 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 18:11:39,626 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-19 18:11:39,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 18:11:39,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 18:11:39,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:39,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:39,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:39,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:39,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 18:11:39,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:39,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:39,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:39,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:39,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,40317,1689790219525': 2023-07-19 18:11:39,637 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40317,1689790219525' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-19 18:11:39,637 INFO [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-19 18:11:39,637 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 18:11:39,637 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 18:11:39,637 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:39,637 INFO [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 18:11:39,641 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:39,642 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:39,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:39,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:39,642 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:39,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 18:11:39,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 18:11:39,642 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:39,642 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:11:39,642 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:11:39,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:39,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:39,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:39,642 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:11:39,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:39,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:39,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 18:11:39,643 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:11:39,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:11:39,643 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:39,643 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:11:39,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:11:39,643 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:11:39,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:11:39,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:39,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:39,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:39,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:39,643 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:39,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 18:11:39,644 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:39,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:39,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:39,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:39,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:39,646 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:39,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 18:11:39,647 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:39,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:39,647 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:39,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:39,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:39,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:39,651 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:11:39,651 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:11:39,651 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:11:39,651 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:11:39,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:11:39,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:11:39,651 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:11:39,651 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:11:39,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:11:39,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:11:39,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:11:39,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:11:39,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:11:39,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:11:39,653 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:11:39,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:11:39,653 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:11:39,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:11:39,654 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:39,654 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:39,654 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:39,654 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:39,654 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:39,654 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:39,654 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 18:11:39,654 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:39,654 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:39,656 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:39,656 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:39,657 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:39,657 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:39,657 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:39,657 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:39,683 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:39,716 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-19 18:11:39,716 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:39,716 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:39,717 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689790298998Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689790299656 (+658 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689790299657 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689790299660 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689790299674 (+14 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689790299716 (+42 ms) 2023-07-19 18:11:39,720 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-19 18:11:39,721 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 721 msec 2023-07-19 18:11:40,111 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 18:11:40,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-19 18:11:40,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 18:11:40,141 DEBUG [Listener at jenkins-hbase4.apache.org/42301] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 18:11:40,146 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53008, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 18:11:40,148 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33037] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-19 18:11:40,149 DEBUG [Listener at jenkins-hbase4.apache.org/42301] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 18:11:40,151 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46136, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 18:11:40,152 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40317] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-19 18:11:40,152 DEBUG [Listener at jenkins-hbase4.apache.org/42301] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 18:11:40,157 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54148, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 18:11:40,157 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44407] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-19 18:11:40,159 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-19 18:11:40,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:40,162 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 18:11:40,163 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-19 18:11:40,164 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 18:11:40,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-19 18:11:40,174 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cad2ca6d1ef9c4158b8a843d7677f72a 2023-07-19 18:11:40,175 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ec92fe6cc467fece4c18ad1b98fe7a87 2023-07-19 18:11:40,175 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cad2ca6d1ef9c4158b8a843d7677f72a empty. 2023-07-19 18:11:40,175 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ec92fe6cc467fece4c18ad1b98fe7a87 empty. 2023-07-19 18:11:40,176 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ec92fe6cc467fece4c18ad1b98fe7a87 2023-07-19 18:11:40,176 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cad2ca6d1ef9c4158b8a843d7677f72a 2023-07-19 18:11:40,176 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-19 18:11:40,189 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-19 18:11:40,190 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => ec92fe6cc467fece4c18ad1b98fe7a87, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689790300159.ec92fe6cc467fece4c18ad1b98fe7a87.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp 2023-07-19 18:11:40,191 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => cad2ca6d1ef9c4158b8a843d7677f72a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689790300159.cad2ca6d1ef9c4158b8a843d7677f72a.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp 2023-07-19 18:11:40,210 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689790300159.ec92fe6cc467fece4c18ad1b98fe7a87.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 18:11:40,211 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing ec92fe6cc467fece4c18ad1b98fe7a87, disabling compactions & flushes 2023-07-19 18:11:40,211 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689790300159.ec92fe6cc467fece4c18ad1b98fe7a87. 2023-07-19 18:11:40,211 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689790300159.ec92fe6cc467fece4c18ad1b98fe7a87. 2023-07-19 18:11:40,211 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689790300159.ec92fe6cc467fece4c18ad1b98fe7a87. after waiting 0 ms 2023-07-19 18:11:40,211 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689790300159.ec92fe6cc467fece4c18ad1b98fe7a87. 2023-07-19 18:11:40,211 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689790300159.ec92fe6cc467fece4c18ad1b98fe7a87. 2023-07-19 18:11:40,211 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for ec92fe6cc467fece4c18ad1b98fe7a87: 2023-07-19 18:11:40,211 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689790300159.cad2ca6d1ef9c4158b8a843d7677f72a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 18:11:40,211 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing cad2ca6d1ef9c4158b8a843d7677f72a, disabling compactions & flushes 2023-07-19 18:11:40,211 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689790300159.cad2ca6d1ef9c4158b8a843d7677f72a. 2023-07-19 18:11:40,211 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689790300159.cad2ca6d1ef9c4158b8a843d7677f72a. 2023-07-19 18:11:40,211 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689790300159.cad2ca6d1ef9c4158b8a843d7677f72a. after waiting 0 ms 2023-07-19 18:11:40,211 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689790300159.cad2ca6d1ef9c4158b8a843d7677f72a. 2023-07-19 18:11:40,211 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689790300159.cad2ca6d1ef9c4158b8a843d7677f72a. 2023-07-19 18:11:40,211 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for cad2ca6d1ef9c4158b8a843d7677f72a: 2023-07-19 18:11:40,214 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 18:11:40,215 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689790300159.ec92fe6cc467fece4c18ad1b98fe7a87.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689790300215"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689790300215"}]},"ts":"1689790300215"} 2023-07-19 18:11:40,215 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689790300159.cad2ca6d1ef9c4158b8a843d7677f72a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689790300215"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689790300215"}]},"ts":"1689790300215"} 2023-07-19 18:11:40,218 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 18:11:40,218 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 18:11:40,219 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689790300219"}]},"ts":"1689790300219"} 2023-07-19 18:11:40,220 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-19 18:11:40,225 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 18:11:40,226 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 18:11:40,226 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 18:11:40,226 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 18:11:40,226 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 18:11:40,226 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=cad2ca6d1ef9c4158b8a843d7677f72a, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ec92fe6cc467fece4c18ad1b98fe7a87, ASSIGN}] 2023-07-19 18:11:40,229 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ec92fe6cc467fece4c18ad1b98fe7a87, ASSIGN 2023-07-19 18:11:40,230 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=cad2ca6d1ef9c4158b8a843d7677f72a, ASSIGN 2023-07-19 18:11:40,230 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ec92fe6cc467fece4c18ad1b98fe7a87, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40317,1689790219525; forceNewPlan=false, retain=false 2023-07-19 18:11:40,231 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=cad2ca6d1ef9c4158b8a843d7677f72a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44407,1689790219668; forceNewPlan=false, retain=false 2023-07-19 18:11:40,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-19 18:11:40,381 INFO [jenkins-hbase4:40453] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 18:11:40,384 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=ec92fe6cc467fece4c18ad1b98fe7a87, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:40,384 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=cad2ca6d1ef9c4158b8a843d7677f72a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:40,384 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689790300159.ec92fe6cc467fece4c18ad1b98fe7a87.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689790300383"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689790300383"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689790300383"}]},"ts":"1689790300383"} 2023-07-19 18:11:40,384 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689790300159.cad2ca6d1ef9c4158b8a843d7677f72a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689790300383"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689790300383"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689790300383"}]},"ts":"1689790300383"} 2023-07-19 18:11:40,386 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure ec92fe6cc467fece4c18ad1b98fe7a87, server=jenkins-hbase4.apache.org,40317,1689790219525}] 2023-07-19 18:11:40,387 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure cad2ca6d1ef9c4158b8a843d7677f72a, server=jenkins-hbase4.apache.org,44407,1689790219668}] 2023-07-19 18:11:40,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-19 18:11:40,541 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689790300159.ec92fe6cc467fece4c18ad1b98fe7a87. 2023-07-19 18:11:40,541 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ec92fe6cc467fece4c18ad1b98fe7a87, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689790300159.ec92fe6cc467fece4c18ad1b98fe7a87.', STARTKEY => '2', ENDKEY => ''} 2023-07-19 18:11:40,542 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689790300159.ec92fe6cc467fece4c18ad1b98fe7a87. service=AccessControlService 2023-07-19 18:11:40,542 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689790300159.cad2ca6d1ef9c4158b8a843d7677f72a. 2023-07-19 18:11:40,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cad2ca6d1ef9c4158b8a843d7677f72a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689790300159.cad2ca6d1ef9c4158b8a843d7677f72a.', STARTKEY => '', ENDKEY => '2'} 2023-07-19 18:11:40,543 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 18:11:40,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 ec92fe6cc467fece4c18ad1b98fe7a87 2023-07-19 18:11:40,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689790300159.cad2ca6d1ef9c4158b8a843d7677f72a. service=AccessControlService 2023-07-19 18:11:40,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689790300159.ec92fe6cc467fece4c18ad1b98fe7a87.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 18:11:40,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ec92fe6cc467fece4c18ad1b98fe7a87 2023-07-19 18:11:40,543 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 18:11:40,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ec92fe6cc467fece4c18ad1b98fe7a87 2023-07-19 18:11:40,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 cad2ca6d1ef9c4158b8a843d7677f72a 2023-07-19 18:11:40,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689790300159.cad2ca6d1ef9c4158b8a843d7677f72a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 18:11:40,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for cad2ca6d1ef9c4158b8a843d7677f72a 2023-07-19 18:11:40,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for cad2ca6d1ef9c4158b8a843d7677f72a 2023-07-19 18:11:40,545 INFO [StoreOpener-cad2ca6d1ef9c4158b8a843d7677f72a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region cad2ca6d1ef9c4158b8a843d7677f72a 2023-07-19 18:11:40,545 INFO [StoreOpener-ec92fe6cc467fece4c18ad1b98fe7a87-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ec92fe6cc467fece4c18ad1b98fe7a87 2023-07-19 18:11:40,547 DEBUG [StoreOpener-cad2ca6d1ef9c4158b8a843d7677f72a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cad2ca6d1ef9c4158b8a843d7677f72a/cf 2023-07-19 18:11:40,547 DEBUG [StoreOpener-ec92fe6cc467fece4c18ad1b98fe7a87-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ec92fe6cc467fece4c18ad1b98fe7a87/cf 2023-07-19 18:11:40,547 DEBUG [StoreOpener-ec92fe6cc467fece4c18ad1b98fe7a87-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ec92fe6cc467fece4c18ad1b98fe7a87/cf 2023-07-19 18:11:40,547 DEBUG [StoreOpener-cad2ca6d1ef9c4158b8a843d7677f72a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cad2ca6d1ef9c4158b8a843d7677f72a/cf 2023-07-19 18:11:40,548 INFO [StoreOpener-cad2ca6d1ef9c4158b8a843d7677f72a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cad2ca6d1ef9c4158b8a843d7677f72a columnFamilyName cf 2023-07-19 18:11:40,548 INFO [StoreOpener-ec92fe6cc467fece4c18ad1b98fe7a87-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ec92fe6cc467fece4c18ad1b98fe7a87 columnFamilyName cf 2023-07-19 18:11:40,548 INFO [StoreOpener-cad2ca6d1ef9c4158b8a843d7677f72a-1] regionserver.HStore(310): Store=cad2ca6d1ef9c4158b8a843d7677f72a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 18:11:40,549 INFO [StoreOpener-ec92fe6cc467fece4c18ad1b98fe7a87-1] regionserver.HStore(310): Store=ec92fe6cc467fece4c18ad1b98fe7a87/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 18:11:40,549 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cad2ca6d1ef9c4158b8a843d7677f72a 2023-07-19 18:11:40,550 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cad2ca6d1ef9c4158b8a843d7677f72a 2023-07-19 18:11:40,550 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ec92fe6cc467fece4c18ad1b98fe7a87 2023-07-19 18:11:40,550 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ec92fe6cc467fece4c18ad1b98fe7a87 2023-07-19 18:11:40,553 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ec92fe6cc467fece4c18ad1b98fe7a87 2023-07-19 18:11:40,554 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for cad2ca6d1ef9c4158b8a843d7677f72a 2023-07-19 18:11:40,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ec92fe6cc467fece4c18ad1b98fe7a87/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 18:11:40,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cad2ca6d1ef9c4158b8a843d7677f72a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 18:11:40,557 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ec92fe6cc467fece4c18ad1b98fe7a87; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73661406, jitterRate=0.09764048457145691}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 18:11:40,557 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ec92fe6cc467fece4c18ad1b98fe7a87: 2023-07-19 18:11:40,557 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened cad2ca6d1ef9c4158b8a843d7677f72a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59377095, jitterRate=-0.1152123361825943}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 18:11:40,557 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for cad2ca6d1ef9c4158b8a843d7677f72a: 2023-07-19 18:11:40,558 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689790300159.cad2ca6d1ef9c4158b8a843d7677f72a., pid=70, masterSystemTime=1689790300539 2023-07-19 18:11:40,559 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689790300159.ec92fe6cc467fece4c18ad1b98fe7a87., pid=69, masterSystemTime=1689790300538 2023-07-19 18:11:40,563 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689790300159.cad2ca6d1ef9c4158b8a843d7677f72a. 2023-07-19 18:11:40,563 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689790300159.cad2ca6d1ef9c4158b8a843d7677f72a. 2023-07-19 18:11:40,565 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=cad2ca6d1ef9c4158b8a843d7677f72a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:40,565 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689790300159.cad2ca6d1ef9c4158b8a843d7677f72a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689790300565"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689790300565"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689790300565"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689790300565"}]},"ts":"1689790300565"} 2023-07-19 18:11:40,565 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689790300159.ec92fe6cc467fece4c18ad1b98fe7a87. 2023-07-19 18:11:40,565 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689790300159.ec92fe6cc467fece4c18ad1b98fe7a87. 2023-07-19 18:11:40,566 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=ec92fe6cc467fece4c18ad1b98fe7a87, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:40,566 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689790300159.ec92fe6cc467fece4c18ad1b98fe7a87.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689790300566"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689790300566"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689790300566"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689790300566"}]},"ts":"1689790300566"} 2023-07-19 18:11:40,577 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=68 2023-07-19 18:11:40,577 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=67 2023-07-19 18:11:40,577 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure ec92fe6cc467fece4c18ad1b98fe7a87, server=jenkins-hbase4.apache.org,40317,1689790219525 in 185 msec 2023-07-19 18:11:40,577 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure cad2ca6d1ef9c4158b8a843d7677f72a, server=jenkins-hbase4.apache.org,44407,1689790219668 in 183 msec 2023-07-19 18:11:40,579 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=cad2ca6d1ef9c4158b8a843d7677f72a, ASSIGN in 351 msec 2023-07-19 18:11:40,579 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=66 2023-07-19 18:11:40,579 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ec92fe6cc467fece4c18ad1b98fe7a87, ASSIGN in 351 msec 2023-07-19 18:11:40,580 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 18:11:40,580 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689790300580"}]},"ts":"1689790300580"} 2023-07-19 18:11:40,581 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-19 18:11:40,584 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 18:11:40,584 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-19 18:11:40,586 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33037] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-19 18:11:40,588 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 18:11:40,588 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 18:11:40,588 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 18:11:40,588 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 18:11:40,591 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 18:11:40,591 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 18:11:40,591 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-19 18:11:40,591 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 18:11:40,591 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-19 18:11:40,591 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-19 18:11:40,591 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 18:11:40,592 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-19 18:11:40,592 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 430 msec 2023-07-19 18:11:40,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-19 18:11:40,769 INFO [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-19 18:11:40,803 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions cad2ca6d1ef9c4158b8a843d7677f72a, ec92fe6cc467fece4c18ad1b98fe7a87 2023-07-19 18:11:40,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[cad2ca6d1ef9c4158b8a843d7677f72a, ec92fe6cc467fece4c18ad1b98fe7a87], force=true 2023-07-19 18:11:40,821 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[cad2ca6d1ef9c4158b8a843d7677f72a, ec92fe6cc467fece4c18ad1b98fe7a87], force=true 2023-07-19 18:11:40,821 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[cad2ca6d1ef9c4158b8a843d7677f72a, ec92fe6cc467fece4c18ad1b98fe7a87], force=true 2023-07-19 18:11:40,821 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[cad2ca6d1ef9c4158b8a843d7677f72a, ec92fe6cc467fece4c18ad1b98fe7a87], force=true 2023-07-19 18:11:40,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-19 18:11:40,847 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=cad2ca6d1ef9c4158b8a843d7677f72a, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ec92fe6cc467fece4c18ad1b98fe7a87, UNASSIGN}] 2023-07-19 18:11:40,849 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=cad2ca6d1ef9c4158b8a843d7677f72a, UNASSIGN 2023-07-19 18:11:40,850 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ec92fe6cc467fece4c18ad1b98fe7a87, UNASSIGN 2023-07-19 18:11:40,851 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=ec92fe6cc467fece4c18ad1b98fe7a87, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:40,851 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=cad2ca6d1ef9c4158b8a843d7677f72a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:40,851 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689790300159.cad2ca6d1ef9c4158b8a843d7677f72a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689790300851"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689790300851"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689790300851"}]},"ts":"1689790300851"} 2023-07-19 18:11:40,851 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689790300159.ec92fe6cc467fece4c18ad1b98fe7a87.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689790300851"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689790300851"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689790300851"}]},"ts":"1689790300851"} 2023-07-19 18:11:40,853 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=73, state=RUNNABLE; CloseRegionProcedure ec92fe6cc467fece4c18ad1b98fe7a87, server=jenkins-hbase4.apache.org,40317,1689790219525}] 2023-07-19 18:11:40,854 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=72, state=RUNNABLE; CloseRegionProcedure cad2ca6d1ef9c4158b8a843d7677f72a, server=jenkins-hbase4.apache.org,44407,1689790219668}] 2023-07-19 18:11:40,893 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-19 18:11:40,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-19 18:11:41,005 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ec92fe6cc467fece4c18ad1b98fe7a87 2023-07-19 18:11:41,007 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ec92fe6cc467fece4c18ad1b98fe7a87, disabling compactions & flushes 2023-07-19 18:11:41,007 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689790300159.ec92fe6cc467fece4c18ad1b98fe7a87. 2023-07-19 18:11:41,007 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689790300159.ec92fe6cc467fece4c18ad1b98fe7a87. 2023-07-19 18:11:41,007 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689790300159.ec92fe6cc467fece4c18ad1b98fe7a87. after waiting 0 ms 2023-07-19 18:11:41,007 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689790300159.ec92fe6cc467fece4c18ad1b98fe7a87. 2023-07-19 18:11:41,007 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing ec92fe6cc467fece4c18ad1b98fe7a87 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-19 18:11:41,008 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close cad2ca6d1ef9c4158b8a843d7677f72a 2023-07-19 18:11:41,009 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing cad2ca6d1ef9c4158b8a843d7677f72a, disabling compactions & flushes 2023-07-19 18:11:41,010 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689790300159.cad2ca6d1ef9c4158b8a843d7677f72a. 2023-07-19 18:11:41,010 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689790300159.cad2ca6d1ef9c4158b8a843d7677f72a. 2023-07-19 18:11:41,010 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689790300159.cad2ca6d1ef9c4158b8a843d7677f72a. after waiting 0 ms 2023-07-19 18:11:41,010 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689790300159.cad2ca6d1ef9c4158b8a843d7677f72a. 2023-07-19 18:11:41,010 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing cad2ca6d1ef9c4158b8a843d7677f72a 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-19 18:11:41,046 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ec92fe6cc467fece4c18ad1b98fe7a87/.tmp/cf/84380e0f7cd845eea8641ce293de6f86 2023-07-19 18:11:41,047 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cad2ca6d1ef9c4158b8a843d7677f72a/.tmp/cf/5379a4c90ee1468fa99c4fbf52844b21 2023-07-19 18:11:41,057 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cad2ca6d1ef9c4158b8a843d7677f72a/.tmp/cf/5379a4c90ee1468fa99c4fbf52844b21 as hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cad2ca6d1ef9c4158b8a843d7677f72a/cf/5379a4c90ee1468fa99c4fbf52844b21 2023-07-19 18:11:41,057 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ec92fe6cc467fece4c18ad1b98fe7a87/.tmp/cf/84380e0f7cd845eea8641ce293de6f86 as hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ec92fe6cc467fece4c18ad1b98fe7a87/cf/84380e0f7cd845eea8641ce293de6f86 2023-07-19 18:11:41,063 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ec92fe6cc467fece4c18ad1b98fe7a87/cf/84380e0f7cd845eea8641ce293de6f86, entries=1, sequenceid=5, filesize=4.7 K 2023-07-19 18:11:41,064 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for ec92fe6cc467fece4c18ad1b98fe7a87 in 57ms, sequenceid=5, compaction requested=false 2023-07-19 18:11:41,066 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cad2ca6d1ef9c4158b8a843d7677f72a/cf/5379a4c90ee1468fa99c4fbf52844b21, entries=1, sequenceid=5, filesize=4.7 K 2023-07-19 18:11:41,067 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for cad2ca6d1ef9c4158b8a843d7677f72a in 57ms, sequenceid=5, compaction requested=false 2023-07-19 18:11:41,097 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ec92fe6cc467fece4c18ad1b98fe7a87/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-19 18:11:41,098 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cad2ca6d1ef9c4158b8a843d7677f72a/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-19 18:11:41,098 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 18:11:41,099 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689790300159.ec92fe6cc467fece4c18ad1b98fe7a87. 2023-07-19 18:11:41,099 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ec92fe6cc467fece4c18ad1b98fe7a87: 2023-07-19 18:11:41,100 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 18:11:41,100 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689790300159.cad2ca6d1ef9c4158b8a843d7677f72a. 2023-07-19 18:11:41,100 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for cad2ca6d1ef9c4158b8a843d7677f72a: 2023-07-19 18:11:41,100 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ec92fe6cc467fece4c18ad1b98fe7a87 2023-07-19 18:11:41,101 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=ec92fe6cc467fece4c18ad1b98fe7a87, regionState=CLOSED 2023-07-19 18:11:41,101 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689790300159.ec92fe6cc467fece4c18ad1b98fe7a87.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689790301101"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689790301101"}]},"ts":"1689790301101"} 2023-07-19 18:11:41,102 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed cad2ca6d1ef9c4158b8a843d7677f72a 2023-07-19 18:11:41,102 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=cad2ca6d1ef9c4158b8a843d7677f72a, regionState=CLOSED 2023-07-19 18:11:41,102 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689790300159.cad2ca6d1ef9c4158b8a843d7677f72a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689790301102"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689790301102"}]},"ts":"1689790301102"} 2023-07-19 18:11:41,105 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=73 2023-07-19 18:11:41,106 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=73, state=SUCCESS; CloseRegionProcedure ec92fe6cc467fece4c18ad1b98fe7a87, server=jenkins-hbase4.apache.org,40317,1689790219525 in 250 msec 2023-07-19 18:11:41,106 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=72 2023-07-19 18:11:41,106 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=72, state=SUCCESS; CloseRegionProcedure cad2ca6d1ef9c4158b8a843d7677f72a, server=jenkins-hbase4.apache.org,44407,1689790219668 in 251 msec 2023-07-19 18:11:41,107 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ec92fe6cc467fece4c18ad1b98fe7a87, UNASSIGN in 259 msec 2023-07-19 18:11:41,108 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-07-19 18:11:41,108 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=cad2ca6d1ef9c4158b8a843d7677f72a, UNASSIGN in 262 msec 2023-07-19 18:11:41,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-19 18:11:41,201 DEBUG [PEWorker-4] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/80687282dba485de08ca4513daafc547/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-19 18:11:41,203 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689790300159.cad2ca6d1ef9c4158b8a843d7677f72a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-19 18:11:41,203 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689790300159.ec92fe6cc467fece4c18ad1b98fe7a87.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-19 18:11:41,203 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689790300160.80687282dba485de08ca4513daafc547.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-19 18:11:41,216 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689790227140_0004_000001 (auth:SIMPLE) 2023-07-19 18:11:41,275 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=80687282dba485de08ca4513daafc547, ASSIGN}] 2023-07-19 18:11:41,276 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=80687282dba485de08ca4513daafc547, ASSIGN 2023-07-19 18:11:41,277 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=80687282dba485de08ca4513daafc547, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,44407,1689790219668; forceNewPlan=false, retain=false 2023-07-19 18:11:41,428 INFO [jenkins-hbase4:40453] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-19 18:11:41,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-19 18:11:41,430 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=80687282dba485de08ca4513daafc547, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:41,430 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689790300160.80687282dba485de08ca4513daafc547.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689790301430"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689790301430"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689790301430"}]},"ts":"1689790301430"} 2023-07-19 18:11:41,432 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 80687282dba485de08ca4513daafc547, server=jenkins-hbase4.apache.org,44407,1689790219668}] 2023-07-19 18:11:41,588 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689790300160.80687282dba485de08ca4513daafc547. 2023-07-19 18:11:41,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 80687282dba485de08ca4513daafc547, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689790300160.80687282dba485de08ca4513daafc547.', STARTKEY => '', ENDKEY => ''} 2023-07-19 18:11:41,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689790300160.80687282dba485de08ca4513daafc547. service=AccessControlService 2023-07-19 18:11:41,589 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 18:11:41,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 80687282dba485de08ca4513daafc547 2023-07-19 18:11:41,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689790300160.80687282dba485de08ca4513daafc547.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 18:11:41,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 80687282dba485de08ca4513daafc547 2023-07-19 18:11:41,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 80687282dba485de08ca4513daafc547 2023-07-19 18:11:41,590 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/80687282dba485de08ca4513daafc547/.regioninfo 2023-07-19 18:11:41,610 INFO [StoreOpener-80687282dba485de08ca4513daafc547-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 80687282dba485de08ca4513daafc547 2023-07-19 18:11:41,611 DEBUG [StoreOpener-80687282dba485de08ca4513daafc547-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/80687282dba485de08ca4513daafc547/cf 2023-07-19 18:11:41,611 DEBUG [StoreOpener-80687282dba485de08ca4513daafc547-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/80687282dba485de08ca4513daafc547/cf 2023-07-19 18:11:41,611 INFO [StoreOpener-80687282dba485de08ca4513daafc547-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 80687282dba485de08ca4513daafc547 columnFamilyName cf 2023-07-19 18:11:41,644 DEBUG [StoreOpener-80687282dba485de08ca4513daafc547-1] regionserver.HStore(539): loaded hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/80687282dba485de08ca4513daafc547/cf/5379a4c90ee1468fa99c4fbf52844b21.cad2ca6d1ef9c4158b8a843d7677f72a->hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cad2ca6d1ef9c4158b8a843d7677f72a/cf/5379a4c90ee1468fa99c4fbf52844b21-top 2023-07-19 18:11:41,650 DEBUG [StoreOpener-80687282dba485de08ca4513daafc547-1] regionserver.HStore(539): loaded hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/80687282dba485de08ca4513daafc547/cf/84380e0f7cd845eea8641ce293de6f86.ec92fe6cc467fece4c18ad1b98fe7a87->hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ec92fe6cc467fece4c18ad1b98fe7a87/cf/84380e0f7cd845eea8641ce293de6f86-top 2023-07-19 18:11:41,651 INFO [StoreOpener-80687282dba485de08ca4513daafc547-1] regionserver.HStore(310): Store=80687282dba485de08ca4513daafc547/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 18:11:41,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/80687282dba485de08ca4513daafc547 2023-07-19 18:11:41,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/80687282dba485de08ca4513daafc547 2023-07-19 18:11:41,656 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 80687282dba485de08ca4513daafc547 2023-07-19 18:11:41,657 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 80687282dba485de08ca4513daafc547; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65999597, jitterRate=-0.016529366374015808}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 18:11:41,658 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 80687282dba485de08ca4513daafc547: 2023-07-19 18:11:41,659 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689790300160.80687282dba485de08ca4513daafc547., pid=77, masterSystemTime=1689790301584 2023-07-19 18:11:41,659 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689790300160.80687282dba485de08ca4513daafc547.,because compaction is disabled. 2023-07-19 18:11:41,661 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689790300160.80687282dba485de08ca4513daafc547. 2023-07-19 18:11:41,661 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689790300160.80687282dba485de08ca4513daafc547. 2023-07-19 18:11:41,661 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=80687282dba485de08ca4513daafc547, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:41,662 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689790300160.80687282dba485de08ca4513daafc547.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689790301661"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689790301661"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689790301661"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689790301661"}]},"ts":"1689790301661"} 2023-07-19 18:11:41,668 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-19 18:11:41,668 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 80687282dba485de08ca4513daafc547, server=jenkins-hbase4.apache.org,44407,1689790219668 in 231 msec 2023-07-19 18:11:41,670 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-19 18:11:41,670 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=80687282dba485de08ca4513daafc547, ASSIGN in 393 msec 2023-07-19 18:11:41,672 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[cad2ca6d1ef9c4158b8a843d7677f72a, ec92fe6cc467fece4c18ad1b98fe7a87], force=true in 861 msec 2023-07-19 18:11:41,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-19 18:11:41,932 INFO [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-19 18:11:41,935 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-19 18:11:41,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689790301935 (current time:1689790301935). 2023-07-19 18:11:41,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 18:11:41,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] zookeeper.ReadOnlyZKClient(139): Connect 0x10a63b6f to 127.0.0.1:51604 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 18:11:41,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@685f2df6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 18:11:41,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 18:11:41,949 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52698, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 18:11:41,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x10a63b6f to 127.0.0.1:51604 2023-07-19 18:11:41,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 18:11:41,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] zookeeper.ReadOnlyZKClient(139): Connect 0x5a15bb31 to 127.0.0.1:51604 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 18:11:41,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7bc99e5f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 18:11:41,961 DEBUG [hconnection-0x6ae83c4d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 18:11:41,964 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52708, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 18:11:41,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5a15bb31 to 127.0.0.1:51604 2023-07-19 18:11:41,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 18:11:41,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-19 18:11:41,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 18:11:41,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-19 18:11:41,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-19 18:11:41,975 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-19 18:11:41,976 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689790901976 2023-07-19 18:11:41,976 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:41,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-19 18:11:41,980 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 18:11:41,980 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 18:11:41,981 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-19 18:11:41,981 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-19 18:11:41,982 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 7 msec 2023-07-19 18:11:41,983 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-19 18:11:41,983 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689790901983 2023-07-19 18:11:42,002 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:42,003 INFO [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-19 18:11:42,003 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 18:11:42,004 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-19 18:11:42,004 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-19 18:11:42,005 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:42,005 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:42,007 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:11:42,007 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:11:42,007 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:11:42,007 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:11:42,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:11:42,007 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:42,007 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:11:42,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:11:42,007 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:11:42,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:11:42,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:42,007 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:42,007 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 18:11:42,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:42,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:42,008 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:42,008 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:42,008 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:42,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-19 18:11:42,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:42,008 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-19 18:11:42,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-19 18:11:42,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:42,008 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-19 18:11:42,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-19 18:11:42,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:42,009 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-19 18:11:42,010 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:42,010 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:42,011 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-19 18:11:42,011 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:42,011 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-19 18:11:42,011 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-19 18:11:42,011 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 18:11:42,011 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 18:11:42,011 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 18:11:42,012 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-19 18:11:42,014 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-19 18:11:42,014 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-19 18:11:42,014 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-19 18:11:42,014 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-19 18:11:42,014 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44407,1689790219668' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-19 18:11:42,014 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-19 18:11:42,014 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40317,1689790219525' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-19 18:11:42,014 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33037,1689790219604' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-19 18:11:42,016 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:42,016 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:42,017 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:42,017 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:42,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:42,017 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:42,017 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 18:11:42,017 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:42,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 18:11:42,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 18:11:42,017 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 18:11:42,017 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:42,017 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 18:11:42,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 18:11:42,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 18:11:42,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:42,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:42,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:42,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:42,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 18:11:42,019 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44407,1689790219668' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-19 18:11:42,019 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@14e1fb2d[Count = 0] remaining members to acquire global barrier 2023-07-19 18:11:42,019 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-19 18:11:42,019 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:42,022 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:42,022 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:42,022 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:42,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:42,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:42,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:42,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:42,022 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-19 18:11:42,022 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-19 18:11:42,022 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:42,022 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 18:11:42,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:42,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:42,022 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-19 18:11:42,022 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,33037,1689790219604' in zk 2023-07-19 18:11:42,022 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-19 18:11:42,022 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-19 18:11:42,022 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,40317,1689790219525' in zk 2023-07-19 18:11:42,024 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-19 18:11:42,024 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 18:11:42,024 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-19 18:11:42,025 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-19 18:11:42,025 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 18:11:42,025 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-19 18:11:42,031 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 18:11:42,031 DEBUG [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689790300160.80687282dba485de08ca4513daafc547. 2023-07-19 18:11:42,031 DEBUG [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689790300160.80687282dba485de08ca4513daafc547. started... 2023-07-19 18:11:42,031 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 18:11:42,033 DEBUG [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 80687282dba485de08ca4513daafc547: 2023-07-19 18:11:42,033 DEBUG [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689790300160.80687282dba485de08ca4513daafc547.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:42,033 DEBUG [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 18:11:42,033 DEBUG [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/80687282dba485de08ca4513daafc547/cf/5379a4c90ee1468fa99c4fbf52844b21.cad2ca6d1ef9c4158b8a843d7677f72a->hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cad2ca6d1ef9c4158b8a843d7677f72a/cf/5379a4c90ee1468fa99c4fbf52844b21-top, hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/80687282dba485de08ca4513daafc547/cf/84380e0f7cd845eea8641ce293de6f86.ec92fe6cc467fece4c18ad1b98fe7a87->hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ec92fe6cc467fece4c18ad1b98fe7a87/cf/84380e0f7cd845eea8641ce293de6f86-top] hfiles 2023-07-19 18:11:42,033 DEBUG [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/80687282dba485de08ca4513daafc547/cf/5379a4c90ee1468fa99c4fbf52844b21.cad2ca6d1ef9c4158b8a843d7677f72a for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:42,034 DEBUG [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/80687282dba485de08ca4513daafc547/cf/84380e0f7cd845eea8641ce293de6f86.ec92fe6cc467fece4c18ad1b98fe7a87 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:42,045 DEBUG [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689790300160.80687282dba485de08ca4513daafc547. completed. 2023-07-19 18:11:42,045 DEBUG [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689790300160.80687282dba485de08ca4513daafc547. 2023-07-19 18:11:42,045 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 18:11:42,045 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 18:11:42,045 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:42,045 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-19 18:11:42,045 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,44407,1689790219668' in zk 2023-07-19 18:11:42,055 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:42,055 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-19 18:11:42,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:42,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 18:11:42,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 18:11:42,055 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 18:11:42,056 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-19 18:11:42,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 18:11:42,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 18:11:42,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:42,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:42,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:42,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:42,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 18:11:42,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:42,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:42,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:42,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:42,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,44407,1689790219668': 2023-07-19 18:11:42,059 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44407,1689790219668' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-19 18:11:42,059 INFO [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-19 18:11:42,059 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 18:11:42,059 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 18:11:42,059 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:42,059 INFO [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 18:11:42,061 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:42,061 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:42,061 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:42,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:42,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:42,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 18:11:42,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 18:11:42,061 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:11:42,061 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:11:42,061 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:42,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:42,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:42,062 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:11:42,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:42,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 18:11:42,062 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:42,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:11:42,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:11:42,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:11:42,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:11:42,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:42,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:42,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:42,063 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:42,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:42,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:42,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:11:42,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:11:42,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 18:11:42,063 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:42,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:42,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:42,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:42,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:42,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:42,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 18:11:42,065 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:42,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:42,065 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:42,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:42,066 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:42,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:42,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:42,068 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:42,068 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:11:42,069 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:42,069 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:11:42,069 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:11:42,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:11:42,069 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:11:42,069 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:42,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:11:42,069 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:42,069 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:42,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:11:42,069 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:11:42,069 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:11:42,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:11:42,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:11:42,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:11:42,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:11:42,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:11:42,069 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 18:11:42,069 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:42,070 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:42,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:11:42,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:11:42,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:11:42,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:11:42,070 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:42,072 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:42,072 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:42,072 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:42,072 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:42,072 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:42,072 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:42,080 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 18:11:42,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-19 18:11:42,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-19 18:11:42,082 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 18:11:42,093 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:42,147 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-19 18:11:42,147 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:42,147 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:42,148 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689790301976Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689790302069 (+93 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689790302069Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689790302075 (+6 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689790302084 (+9 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689790302147 (+63 ms) 2023-07-19 18:11:42,150 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-19 18:11:42,155 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 171 msec 2023-07-19 18:11:42,282 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 18:11:42,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-19 18:11:42,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 18:11:42,284 INFO [Listener at jenkins-hbase4.apache.org/42301] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/export-test/export-1689790302284 2023-07-19 18:11:42,284 INFO [Listener at jenkins-hbase4.apache.org/42301] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:40881, tgtDir=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/export-test/export-1689790302284, rawTgtDir=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/export-test/export-1689790302284, srcFsUri=hdfs://localhost:40881, srcDir=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf 2023-07-19 18:11:42,317 DEBUG [Listener at jenkins-hbase4.apache.org/42301] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:40881, inputRoot=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf 2023-07-19 18:11:42,317 DEBUG [Listener at jenkins-hbase4.apache.org/42301] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1591617557_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/export-test/export-1689790302284, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/export-test/export-1689790302284/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:42,317 INFO [Listener at jenkins-hbase4.apache.org/42301] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:40881, inputRoot=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf, snapshotDir=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-19 18:11:42,339 INFO [Listener at jenkins-hbase4.apache.org/42301] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/export-test/export-1689790302284/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:42,405 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 18:11:42,406 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 18:11:42,407 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 18:11:42,407 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 18:11:42,408 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-19 18:11:42,408 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 18:11:42,409 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 18:11:42,487 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/hadoop-1871233380278045266.jar 2023-07-19 18:11:42,488 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 18:11:42,488 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 18:11:42,489 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 18:11:42,489 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 18:11:42,490 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 18:11:42,490 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 18:11:42,491 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 18:11:42,491 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 18:11:42,492 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 18:11:42,493 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 18:11:42,493 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 18:11:42,494 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 18:11:42,495 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 18:11:42,495 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 18:11:42,496 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 18:11:42,496 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 18:11:42,497 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 18:11:42,497 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 18:11:42,498 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 18:11:42,498 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 18:11:42,499 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 18:11:42,499 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 18:11:42,500 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 18:11:42,895 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 18:11:43,234 WARN [Listener at jenkins-hbase4.apache.org/42301] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 18:11:43,238 INFO [Listener at jenkins-hbase4.apache.org/42301] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-19 18:11:43,240 DEBUG [Listener at jenkins-hbase4.apache.org/42301] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-19 18:11:43,361 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 18:11:43,361 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 18:11:43,537 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689790227140_0005_000001 (auth:SIMPLE) 2023-07-19 18:11:49,226 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689790227140_0005_000001 (auth:SIMPLE) 2023-07-19 18:11:51,639 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689790227140_0005_000001 (auth:SIMPLE) 2023-07-19 18:11:55,767 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689790227140_0005_000001 (auth:SIMPLE) 2023-07-19 18:11:57,600 INFO [Listener at jenkins-hbase4.apache.org/42301] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 18:11:57,613 INFO [Listener at jenkins-hbase4.apache.org/42301] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 18:11:57,652 INFO [Listener at jenkins-hbase4.apache.org/42301] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:57,652 INFO [Listener at jenkins-hbase4.apache.org/42301] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 18:11:57,653 INFO [Listener at jenkins-hbase4.apache.org/42301] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 18:11:57,653 DEBUG [Listener at jenkins-hbase4.apache.org/42301] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2119224145_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:57,653 DEBUG [Listener at jenkins-hbase4.apache.org/42301] snapshot.TestExportSnapshot(367): hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-19 18:11:57,654 DEBUG [Listener at jenkins-hbase4.apache.org/42301] snapshot.TestExportSnapshot(367): hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-19 18:11:57,654 DEBUG [Listener at jenkins-hbase4.apache.org/42301] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2119224145_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/export-test/export-1689790302284/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/export-test/export-1689790302284/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:57,654 DEBUG [Listener at jenkins-hbase4.apache.org/42301] snapshot.TestExportSnapshot(367): hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/export-test/export-1689790302284/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-19 18:11:57,654 DEBUG [Listener at jenkins-hbase4.apache.org/42301] snapshot.TestExportSnapshot(367): hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/export-test/export-1689790302284/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-19 18:11:57,664 INFO [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:57,665 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:57,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:57,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-19 18:11:57,673 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689790317672"}]},"ts":"1689790317672"} 2023-07-19 18:11:57,674 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-19 18:11:57,710 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-19 18:11:57,712 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=80687282dba485de08ca4513daafc547, UNASSIGN}] 2023-07-19 18:11:57,715 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=80687282dba485de08ca4513daafc547, UNASSIGN 2023-07-19 18:11:57,715 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=80687282dba485de08ca4513daafc547, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:57,716 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689790300160.80687282dba485de08ca4513daafc547.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689790317715"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689790317715"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689790317715"}]},"ts":"1689790317715"} 2023-07-19 18:11:57,717 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 80687282dba485de08ca4513daafc547, server=jenkins-hbase4.apache.org,44407,1689790219668}] 2023-07-19 18:11:57,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-19 18:11:57,869 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 80687282dba485de08ca4513daafc547 2023-07-19 18:11:57,870 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 80687282dba485de08ca4513daafc547, disabling compactions & flushes 2023-07-19 18:11:57,870 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689790300160.80687282dba485de08ca4513daafc547. 2023-07-19 18:11:57,870 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689790300160.80687282dba485de08ca4513daafc547. 2023-07-19 18:11:57,870 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689790300160.80687282dba485de08ca4513daafc547. after waiting 0 ms 2023-07-19 18:11:57,870 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689790300160.80687282dba485de08ca4513daafc547. 2023-07-19 18:11:57,889 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/80687282dba485de08ca4513daafc547/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-19 18:11:57,890 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 18:11:57,891 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689790300160.80687282dba485de08ca4513daafc547. 2023-07-19 18:11:57,891 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 80687282dba485de08ca4513daafc547: 2023-07-19 18:11:57,893 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 80687282dba485de08ca4513daafc547 2023-07-19 18:11:57,894 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=80687282dba485de08ca4513daafc547, regionState=CLOSED 2023-07-19 18:11:57,894 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689790300160.80687282dba485de08ca4513daafc547.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689790317894"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689790317894"}]},"ts":"1689790317894"} 2023-07-19 18:11:57,898 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-19 18:11:57,898 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 80687282dba485de08ca4513daafc547, server=jenkins-hbase4.apache.org,44407,1689790219668 in 179 msec 2023-07-19 18:11:57,901 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-19 18:11:57,901 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=80687282dba485de08ca4513daafc547, UNASSIGN in 186 msec 2023-07-19 18:11:57,902 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689790317902"}]},"ts":"1689790317902"} 2023-07-19 18:11:57,912 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-19 18:11:57,926 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-19 18:11:57,928 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 262 msec 2023-07-19 18:11:57,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-19 18:11:57,975 INFO [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-19 18:11:57,976 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:57,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:57,995 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:57,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:57,996 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:57,998 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33037] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:58,005 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:58,005 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:58,005 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:58,005 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:58,006 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-19 18:11:58,006 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-19 18:11:58,006 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-19 18:11:58,011 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ec92fe6cc467fece4c18ad1b98fe7a87 2023-07-19 18:11:58,011 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cad2ca6d1ef9c4158b8a843d7677f72a 2023-07-19 18:11:58,011 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/80687282dba485de08ca4513daafc547 2023-07-19 18:11:58,012 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:58,012 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 18:11:58,013 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:58,013 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 18:11:58,013 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 18:11:58,014 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 18:11:58,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-19 18:11:58,015 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:58,015 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 18:11:58,015 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 18:11:58,015 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ec92fe6cc467fece4c18ad1b98fe7a87/cf, FileablePath, hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ec92fe6cc467fece4c18ad1b98fe7a87/recovered.edits] 2023-07-19 18:11:58,017 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/80687282dba485de08ca4513daafc547/cf, FileablePath, hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/80687282dba485de08ca4513daafc547/recovered.edits] 2023-07-19 18:11:58,015 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-19 18:11:58,018 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-19 18:11:58,019 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 18:11:58,019 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 18:11:58,020 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cad2ca6d1ef9c4158b8a843d7677f72a/cf, FileablePath, hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cad2ca6d1ef9c4158b8a843d7677f72a/recovered.edits] 2023-07-19 18:11:58,022 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ec92fe6cc467fece4c18ad1b98fe7a87/cf/84380e0f7cd845eea8641ce293de6f86 to hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ec92fe6cc467fece4c18ad1b98fe7a87/cf/84380e0f7cd845eea8641ce293de6f86 2023-07-19 18:11:58,026 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/80687282dba485de08ca4513daafc547/cf/5379a4c90ee1468fa99c4fbf52844b21.cad2ca6d1ef9c4158b8a843d7677f72a to hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/80687282dba485de08ca4513daafc547/cf/5379a4c90ee1468fa99c4fbf52844b21.cad2ca6d1ef9c4158b8a843d7677f72a 2023-07-19 18:11:58,027 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cad2ca6d1ef9c4158b8a843d7677f72a/cf/5379a4c90ee1468fa99c4fbf52844b21 to hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cad2ca6d1ef9c4158b8a843d7677f72a/cf/5379a4c90ee1468fa99c4fbf52844b21 2023-07-19 18:11:58,031 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ec92fe6cc467fece4c18ad1b98fe7a87/recovered.edits/8.seqid to hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ec92fe6cc467fece4c18ad1b98fe7a87/recovered.edits/8.seqid 2023-07-19 18:11:58,031 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ec92fe6cc467fece4c18ad1b98fe7a87 2023-07-19 18:11:58,033 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/80687282dba485de08ca4513daafc547/cf/84380e0f7cd845eea8641ce293de6f86.ec92fe6cc467fece4c18ad1b98fe7a87 to hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/80687282dba485de08ca4513daafc547/cf/84380e0f7cd845eea8641ce293de6f86.ec92fe6cc467fece4c18ad1b98fe7a87 2023-07-19 18:11:58,035 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cad2ca6d1ef9c4158b8a843d7677f72a/recovered.edits/8.seqid to hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cad2ca6d1ef9c4158b8a843d7677f72a/recovered.edits/8.seqid 2023-07-19 18:11:58,036 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cad2ca6d1ef9c4158b8a843d7677f72a 2023-07-19 18:11:58,039 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/80687282dba485de08ca4513daafc547/recovered.edits/12.seqid to hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/80687282dba485de08ca4513daafc547/recovered.edits/12.seqid 2023-07-19 18:11:58,039 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/80687282dba485de08ca4513daafc547 2023-07-19 18:11:58,040 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-19 18:11:58,042 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:58,050 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-19 18:11:58,063 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-19 18:11:58,064 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:58,064 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-19 18:11:58,065 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689790300160.80687282dba485de08ca4513daafc547.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689790318065"}]},"ts":"9223372036854775807"} 2023-07-19 18:11:58,074 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-19 18:11:58,074 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 80687282dba485de08ca4513daafc547, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689790300160.80687282dba485de08ca4513daafc547.', STARTKEY => '', ENDKEY => ''}] 2023-07-19 18:11:58,074 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-19 18:11:58,074 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689790318074"}]},"ts":"9223372036854775807"} 2023-07-19 18:11:58,085 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-19 18:11:58,087 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:58,089 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 111 msec 2023-07-19 18:11:58,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-19 18:11:58,116 INFO [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-19 18:11:58,117 INFO [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:58,117 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:58,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:58,125 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689790318124"}]},"ts":"1689790318124"} 2023-07-19 18:11:58,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-19 18:11:58,127 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-19 18:11:58,129 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-19 18:11:58,130 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=018416be9de25ae12dd96a74f0a674a7, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1e449696eaee28dc66406af52c4f95a5, UNASSIGN}] 2023-07-19 18:11:58,137 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=018416be9de25ae12dd96a74f0a674a7, UNASSIGN 2023-07-19 18:11:58,137 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1e449696eaee28dc66406af52c4f95a5, UNASSIGN 2023-07-19 18:11:58,138 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=018416be9de25ae12dd96a74f0a674a7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:58,138 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=1e449696eaee28dc66406af52c4f95a5, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:58,138 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689790297592.018416be9de25ae12dd96a74f0a674a7.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689790318138"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689790318138"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689790318138"}]},"ts":"1689790318138"} 2023-07-19 18:11:58,138 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689790297592.1e449696eaee28dc66406af52c4f95a5.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689790318138"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689790318138"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689790318138"}]},"ts":"1689790318138"} 2023-07-19 18:11:58,140 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 018416be9de25ae12dd96a74f0a674a7, server=jenkins-hbase4.apache.org,33037,1689790219604}] 2023-07-19 18:11:58,149 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 1e449696eaee28dc66406af52c4f95a5, server=jenkins-hbase4.apache.org,40317,1689790219525}] 2023-07-19 18:11:58,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-19 18:11:58,295 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 018416be9de25ae12dd96a74f0a674a7 2023-07-19 18:11:58,295 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 018416be9de25ae12dd96a74f0a674a7, disabling compactions & flushes 2023-07-19 18:11:58,296 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689790297592.018416be9de25ae12dd96a74f0a674a7. 2023-07-19 18:11:58,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689790297592.018416be9de25ae12dd96a74f0a674a7. 2023-07-19 18:11:58,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689790297592.018416be9de25ae12dd96a74f0a674a7. after waiting 0 ms 2023-07-19 18:11:58,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689790297592.018416be9de25ae12dd96a74f0a674a7. 2023-07-19 18:11:58,310 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 1e449696eaee28dc66406af52c4f95a5 2023-07-19 18:11:58,311 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1e449696eaee28dc66406af52c4f95a5, disabling compactions & flushes 2023-07-19 18:11:58,311 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689790297592.1e449696eaee28dc66406af52c4f95a5. 2023-07-19 18:11:58,311 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689790297592.1e449696eaee28dc66406af52c4f95a5. 2023-07-19 18:11:58,311 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689790297592.1e449696eaee28dc66406af52c4f95a5. after waiting 0 ms 2023-07-19 18:11:58,311 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689790297592.1e449696eaee28dc66406af52c4f95a5. 2023-07-19 18:11:58,317 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithMergeRegion/018416be9de25ae12dd96a74f0a674a7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 18:11:58,322 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 18:11:58,323 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689790297592.018416be9de25ae12dd96a74f0a674a7. 2023-07-19 18:11:58,323 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 018416be9de25ae12dd96a74f0a674a7: 2023-07-19 18:11:58,327 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 018416be9de25ae12dd96a74f0a674a7 2023-07-19 18:11:58,327 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=018416be9de25ae12dd96a74f0a674a7, regionState=CLOSED 2023-07-19 18:11:58,328 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689790297592.018416be9de25ae12dd96a74f0a674a7.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689790318327"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689790318327"}]},"ts":"1689790318327"} 2023-07-19 18:11:58,331 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=85 2023-07-19 18:11:58,331 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 018416be9de25ae12dd96a74f0a674a7, server=jenkins-hbase4.apache.org,33037,1689790219604 in 189 msec 2023-07-19 18:11:58,332 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=018416be9de25ae12dd96a74f0a674a7, UNASSIGN in 201 msec 2023-07-19 18:11:58,351 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithMergeRegion/1e449696eaee28dc66406af52c4f95a5/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 18:11:58,358 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 18:11:58,360 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689790297592.1e449696eaee28dc66406af52c4f95a5. 2023-07-19 18:11:58,360 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1e449696eaee28dc66406af52c4f95a5: 2023-07-19 18:11:58,363 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 1e449696eaee28dc66406af52c4f95a5 2023-07-19 18:11:58,364 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=1e449696eaee28dc66406af52c4f95a5, regionState=CLOSED 2023-07-19 18:11:58,364 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689790297592.1e449696eaee28dc66406af52c4f95a5.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689790318364"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689790318364"}]},"ts":"1689790318364"} 2023-07-19 18:11:58,377 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=86 2023-07-19 18:11:58,377 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 1e449696eaee28dc66406af52c4f95a5, server=jenkins-hbase4.apache.org,40317,1689790219525 in 217 msec 2023-07-19 18:11:58,382 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=86, resume processing ppid=84 2023-07-19 18:11:58,382 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1e449696eaee28dc66406af52c4f95a5, UNASSIGN in 247 msec 2023-07-19 18:11:58,383 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689790318383"}]},"ts":"1689790318383"} 2023-07-19 18:11:58,385 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-19 18:11:58,387 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-19 18:11:58,389 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 271 msec 2023-07-19 18:11:58,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-19 18:11:58,430 INFO [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-19 18:11:58,431 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:58,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:58,436 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:58,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:58,437 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:58,444 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33037] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:58,449 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:58,449 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:58,449 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:58,449 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:58,449 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-19 18:11:58,450 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-19 18:11:58,450 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/018416be9de25ae12dd96a74f0a674a7 2023-07-19 18:11:58,450 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-19 18:11:58,450 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1e449696eaee28dc66406af52c4f95a5 2023-07-19 18:11:58,450 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-19 18:11:58,451 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:58,451 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:58,451 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:58,451 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 18:11:58,451 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 18:11:58,451 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:58,451 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 18:11:58,451 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 18:11:58,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-19 18:11:58,454 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/018416be9de25ae12dd96a74f0a674a7/cf, FileablePath, hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/018416be9de25ae12dd96a74f0a674a7/recovered.edits] 2023-07-19 18:11:58,454 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1e449696eaee28dc66406af52c4f95a5/cf, FileablePath, hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1e449696eaee28dc66406af52c4f95a5/recovered.edits] 2023-07-19 18:11:58,464 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/018416be9de25ae12dd96a74f0a674a7/cf/0c246c47e3cf40ad9175555242a62579 to hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/018416be9de25ae12dd96a74f0a674a7/cf/0c246c47e3cf40ad9175555242a62579 2023-07-19 18:11:58,464 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1e449696eaee28dc66406af52c4f95a5/cf/1b1fa345e24e4f1796f10f5b9fafddce to hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/1e449696eaee28dc66406af52c4f95a5/cf/1b1fa345e24e4f1796f10f5b9fafddce 2023-07-19 18:11:58,471 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/018416be9de25ae12dd96a74f0a674a7/recovered.edits/9.seqid to hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/018416be9de25ae12dd96a74f0a674a7/recovered.edits/9.seqid 2023-07-19 18:11:58,471 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1e449696eaee28dc66406af52c4f95a5/recovered.edits/9.seqid to hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/1e449696eaee28dc66406af52c4f95a5/recovered.edits/9.seqid 2023-07-19 18:11:58,471 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/018416be9de25ae12dd96a74f0a674a7 2023-07-19 18:11:58,472 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1e449696eaee28dc66406af52c4f95a5 2023-07-19 18:11:58,472 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-19 18:11:58,474 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:58,488 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-19 18:11:58,496 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-19 18:11:58,497 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:58,497 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-19 18:11:58,497 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689790297592.018416be9de25ae12dd96a74f0a674a7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689790318497"}]},"ts":"9223372036854775807"} 2023-07-19 18:11:58,497 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689790297592.1e449696eaee28dc66406af52c4f95a5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689790318497"}]},"ts":"9223372036854775807"} 2023-07-19 18:11:58,499 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-19 18:11:58,499 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 018416be9de25ae12dd96a74f0a674a7, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689790297592.018416be9de25ae12dd96a74f0a674a7.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 1e449696eaee28dc66406af52c4f95a5, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689790297592.1e449696eaee28dc66406af52c4f95a5.', STARTKEY => '1', ENDKEY => ''}] 2023-07-19 18:11:58,499 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-19 18:11:58,499 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689790318499"}]},"ts":"9223372036854775807"} 2023-07-19 18:11:58,501 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-19 18:11:58,503 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:58,505 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 73 msec 2023-07-19 18:11:58,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-19 18:11:58,558 INFO [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-19 18:11:58,577 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-19 18:11:58,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:58,582 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-19 18:11:58,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 18:11:58,587 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-19 18:11:58,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 18:11:58,630 INFO [Listener at jenkins-hbase4.apache.org/42301] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=762 (was 749) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2119224145_17 at /127.0.0.1:43138 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2119224145_17 at /127.0.0.1:44896 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3af1d18e-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3af1d18e-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3af1d18e-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3af1d18e-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3af1d18e-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3af1d18e-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2067934572_1 at /127.0.0.1:44860 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1477432893) connection to jenkins-hbase4.apache.org/172.31.14.131:34417 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2119224145_17 at /127.0.0.1:55522 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2067934572_1 at /127.0.0.1:43116 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4062 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=905 (was 894) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=660 (was 444) - SystemLoadAverage LEAK? -, ProcessCount=188 (was 184) - ProcessCount LEAK? -, AvailableMemoryMB=2489 (was 2901) 2023-07-19 18:11:58,631 WARN [Listener at jenkins-hbase4.apache.org/42301] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-19 18:11:58,668 INFO [Listener at jenkins-hbase4.apache.org/42301] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=762, OpenFileDescriptor=905, MaxFileDescriptor=60000, SystemLoadAverage=660, ProcessCount=188, AvailableMemoryMB=2481 2023-07-19 18:11:58,668 WARN [Listener at jenkins-hbase4.apache.org/42301] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-19 18:11:58,671 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-19 18:11:58,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 18:11:58,675 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 18:11:58,676 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-19 18:11:58,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-19 18:11:58,679 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 18:11:58,682 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testEmptyExportFileSystemState/fdf40efcf427b4e30d1aa31c7701ac80 2023-07-19 18:11:58,682 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testEmptyExportFileSystemState/349b694c46432a76b92ba931ff230909 2023-07-19 18:11:58,683 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testEmptyExportFileSystemState/fdf40efcf427b4e30d1aa31c7701ac80 empty. 2023-07-19 18:11:58,684 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testEmptyExportFileSystemState/349b694c46432a76b92ba931ff230909 empty. 2023-07-19 18:11:58,684 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testEmptyExportFileSystemState/fdf40efcf427b4e30d1aa31c7701ac80 2023-07-19 18:11:58,684 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testEmptyExportFileSystemState/349b694c46432a76b92ba931ff230909 2023-07-19 18:11:58,684 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-19 18:11:58,772 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-19 18:11:58,773 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => fdf40efcf427b4e30d1aa31c7701ac80, NAME => 'testtb-testEmptyExportFileSystemState,,1689790318670.fdf40efcf427b4e30d1aa31c7701ac80.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp 2023-07-19 18:11:58,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-19 18:11:58,784 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 349b694c46432a76b92ba931ff230909, NAME => 'testtb-testEmptyExportFileSystemState,1,1689790318670.349b694c46432a76b92ba931ff230909.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp 2023-07-19 18:11:58,827 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689790318670.fdf40efcf427b4e30d1aa31c7701ac80.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 18:11:58,827 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing fdf40efcf427b4e30d1aa31c7701ac80, disabling compactions & flushes 2023-07-19 18:11:58,827 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689790318670.fdf40efcf427b4e30d1aa31c7701ac80. 2023-07-19 18:11:58,827 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689790318670.fdf40efcf427b4e30d1aa31c7701ac80. 2023-07-19 18:11:58,827 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689790318670.fdf40efcf427b4e30d1aa31c7701ac80. after waiting 0 ms 2023-07-19 18:11:58,827 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689790318670.fdf40efcf427b4e30d1aa31c7701ac80. 2023-07-19 18:11:58,827 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689790318670.fdf40efcf427b4e30d1aa31c7701ac80. 2023-07-19 18:11:58,827 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for fdf40efcf427b4e30d1aa31c7701ac80: 2023-07-19 18:11:58,848 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689790318670.349b694c46432a76b92ba931ff230909.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 18:11:58,848 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 349b694c46432a76b92ba931ff230909, disabling compactions & flushes 2023-07-19 18:11:58,848 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689790318670.349b694c46432a76b92ba931ff230909. 2023-07-19 18:11:58,848 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689790318670.349b694c46432a76b92ba931ff230909. 2023-07-19 18:11:58,848 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689790318670.349b694c46432a76b92ba931ff230909. after waiting 0 ms 2023-07-19 18:11:58,848 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689790318670.349b694c46432a76b92ba931ff230909. 2023-07-19 18:11:58,848 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689790318670.349b694c46432a76b92ba931ff230909. 2023-07-19 18:11:58,849 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 349b694c46432a76b92ba931ff230909: 2023-07-19 18:11:58,853 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 18:11:58,854 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689790318670.fdf40efcf427b4e30d1aa31c7701ac80.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689790318854"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689790318854"}]},"ts":"1689790318854"} 2023-07-19 18:11:58,854 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689790318670.349b694c46432a76b92ba931ff230909.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689790318854"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689790318854"}]},"ts":"1689790318854"} 2023-07-19 18:11:58,857 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 18:11:58,858 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 18:11:58,858 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689790318858"}]},"ts":"1689790318858"} 2023-07-19 18:11:58,860 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-19 18:11:58,865 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 18:11:58,867 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 18:11:58,867 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 18:11:58,867 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 18:11:58,867 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 18:11:58,868 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=fdf40efcf427b4e30d1aa31c7701ac80, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=349b694c46432a76b92ba931ff230909, ASSIGN}] 2023-07-19 18:11:58,873 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=349b694c46432a76b92ba931ff230909, ASSIGN 2023-07-19 18:11:58,874 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=fdf40efcf427b4e30d1aa31c7701ac80, ASSIGN 2023-07-19 18:11:58,886 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=349b694c46432a76b92ba931ff230909, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40317,1689790219525; forceNewPlan=false, retain=false 2023-07-19 18:11:58,886 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=fdf40efcf427b4e30d1aa31c7701ac80, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33037,1689790219604; forceNewPlan=false, retain=false 2023-07-19 18:11:58,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-19 18:11:59,037 INFO [jenkins-hbase4:40453] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 18:11:59,040 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=fdf40efcf427b4e30d1aa31c7701ac80, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:59,040 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689790318670.fdf40efcf427b4e30d1aa31c7701ac80.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689790319040"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689790319040"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689790319040"}]},"ts":"1689790319040"} 2023-07-19 18:11:59,040 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=349b694c46432a76b92ba931ff230909, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:59,041 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689790318670.349b694c46432a76b92ba931ff230909.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689790319040"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689790319040"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689790319040"}]},"ts":"1689790319040"} 2023-07-19 18:11:59,043 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure fdf40efcf427b4e30d1aa31c7701ac80, server=jenkins-hbase4.apache.org,33037,1689790219604}] 2023-07-19 18:11:59,043 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure 349b694c46432a76b92ba931ff230909, server=jenkins-hbase4.apache.org,40317,1689790219525}] 2023-07-19 18:11:59,199 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689790318670.349b694c46432a76b92ba931ff230909. 2023-07-19 18:11:59,199 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 349b694c46432a76b92ba931ff230909, NAME => 'testtb-testEmptyExportFileSystemState,1,1689790318670.349b694c46432a76b92ba931ff230909.', STARTKEY => '1', ENDKEY => ''} 2023-07-19 18:11:59,199 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689790318670.349b694c46432a76b92ba931ff230909. service=AccessControlService 2023-07-19 18:11:59,200 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 18:11:59,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 349b694c46432a76b92ba931ff230909 2023-07-19 18:11:59,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689790318670.349b694c46432a76b92ba931ff230909.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 18:11:59,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 349b694c46432a76b92ba931ff230909 2023-07-19 18:11:59,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 349b694c46432a76b92ba931ff230909 2023-07-19 18:11:59,199 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689790318670.fdf40efcf427b4e30d1aa31c7701ac80. 2023-07-19 18:11:59,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fdf40efcf427b4e30d1aa31c7701ac80, NAME => 'testtb-testEmptyExportFileSystemState,,1689790318670.fdf40efcf427b4e30d1aa31c7701ac80.', STARTKEY => '', ENDKEY => '1'} 2023-07-19 18:11:59,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689790318670.fdf40efcf427b4e30d1aa31c7701ac80. service=AccessControlService 2023-07-19 18:11:59,201 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 18:11:59,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState fdf40efcf427b4e30d1aa31c7701ac80 2023-07-19 18:11:59,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689790318670.fdf40efcf427b4e30d1aa31c7701ac80.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 18:11:59,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for fdf40efcf427b4e30d1aa31c7701ac80 2023-07-19 18:11:59,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for fdf40efcf427b4e30d1aa31c7701ac80 2023-07-19 18:11:59,202 INFO [StoreOpener-349b694c46432a76b92ba931ff230909-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 349b694c46432a76b92ba931ff230909 2023-07-19 18:11:59,203 INFO [StoreOpener-fdf40efcf427b4e30d1aa31c7701ac80-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region fdf40efcf427b4e30d1aa31c7701ac80 2023-07-19 18:11:59,203 DEBUG [StoreOpener-349b694c46432a76b92ba931ff230909-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testEmptyExportFileSystemState/349b694c46432a76b92ba931ff230909/cf 2023-07-19 18:11:59,203 DEBUG [StoreOpener-349b694c46432a76b92ba931ff230909-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testEmptyExportFileSystemState/349b694c46432a76b92ba931ff230909/cf 2023-07-19 18:11:59,204 INFO [StoreOpener-349b694c46432a76b92ba931ff230909-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 349b694c46432a76b92ba931ff230909 columnFamilyName cf 2023-07-19 18:11:59,206 DEBUG [StoreOpener-fdf40efcf427b4e30d1aa31c7701ac80-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testEmptyExportFileSystemState/fdf40efcf427b4e30d1aa31c7701ac80/cf 2023-07-19 18:11:59,207 DEBUG [StoreOpener-fdf40efcf427b4e30d1aa31c7701ac80-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testEmptyExportFileSystemState/fdf40efcf427b4e30d1aa31c7701ac80/cf 2023-07-19 18:11:59,207 INFO [StoreOpener-349b694c46432a76b92ba931ff230909-1] regionserver.HStore(310): Store=349b694c46432a76b92ba931ff230909/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 18:11:59,207 INFO [StoreOpener-fdf40efcf427b4e30d1aa31c7701ac80-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fdf40efcf427b4e30d1aa31c7701ac80 columnFamilyName cf 2023-07-19 18:11:59,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testEmptyExportFileSystemState/349b694c46432a76b92ba931ff230909 2023-07-19 18:11:59,208 INFO [StoreOpener-fdf40efcf427b4e30d1aa31c7701ac80-1] regionserver.HStore(310): Store=fdf40efcf427b4e30d1aa31c7701ac80/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 18:11:59,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testEmptyExportFileSystemState/349b694c46432a76b92ba931ff230909 2023-07-19 18:11:59,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testEmptyExportFileSystemState/fdf40efcf427b4e30d1aa31c7701ac80 2023-07-19 18:11:59,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testEmptyExportFileSystemState/fdf40efcf427b4e30d1aa31c7701ac80 2023-07-19 18:11:59,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 349b694c46432a76b92ba931ff230909 2023-07-19 18:11:59,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for fdf40efcf427b4e30d1aa31c7701ac80 2023-07-19 18:11:59,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testEmptyExportFileSystemState/349b694c46432a76b92ba931ff230909/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 18:11:59,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testEmptyExportFileSystemState/fdf40efcf427b4e30d1aa31c7701ac80/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 18:11:59,215 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 349b694c46432a76b92ba931ff230909; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69135336, jitterRate=0.030196785926818848}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 18:11:59,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 349b694c46432a76b92ba931ff230909: 2023-07-19 18:11:59,215 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened fdf40efcf427b4e30d1aa31c7701ac80; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62904530, jitterRate=-0.06264945864677429}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 18:11:59,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for fdf40efcf427b4e30d1aa31c7701ac80: 2023-07-19 18:11:59,216 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689790318670.fdf40efcf427b4e30d1aa31c7701ac80., pid=93, masterSystemTime=1689790319196 2023-07-19 18:11:59,216 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689790318670.349b694c46432a76b92ba931ff230909., pid=94, masterSystemTime=1689790319196 2023-07-19 18:11:59,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689790318670.fdf40efcf427b4e30d1aa31c7701ac80. 2023-07-19 18:11:59,217 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689790318670.fdf40efcf427b4e30d1aa31c7701ac80. 2023-07-19 18:11:59,218 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=fdf40efcf427b4e30d1aa31c7701ac80, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:59,218 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689790318670.349b694c46432a76b92ba931ff230909. 2023-07-19 18:11:59,218 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689790318670.349b694c46432a76b92ba931ff230909. 2023-07-19 18:11:59,218 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689790318670.fdf40efcf427b4e30d1aa31c7701ac80.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689790319218"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689790319218"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689790319218"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689790319218"}]},"ts":"1689790319218"} 2023-07-19 18:11:59,218 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=349b694c46432a76b92ba931ff230909, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:59,219 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689790318670.349b694c46432a76b92ba931ff230909.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689790319218"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689790319218"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689790319218"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689790319218"}]},"ts":"1689790319218"} 2023-07-19 18:11:59,221 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=91 2023-07-19 18:11:59,222 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure fdf40efcf427b4e30d1aa31c7701ac80, server=jenkins-hbase4.apache.org,33037,1689790219604 in 178 msec 2023-07-19 18:11:59,222 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=92 2023-07-19 18:11:59,223 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure 349b694c46432a76b92ba931ff230909, server=jenkins-hbase4.apache.org,40317,1689790219525 in 177 msec 2023-07-19 18:11:59,223 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=fdf40efcf427b4e30d1aa31c7701ac80, ASSIGN in 354 msec 2023-07-19 18:11:59,224 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-07-19 18:11:59,224 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=349b694c46432a76b92ba931ff230909, ASSIGN in 355 msec 2023-07-19 18:11:59,225 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 18:11:59,225 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689790319225"}]},"ts":"1689790319225"} 2023-07-19 18:11:59,226 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-19 18:11:59,228 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 18:11:59,229 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-19 18:11:59,230 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33037] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-19 18:11:59,232 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 18:11:59,232 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 18:11:59,232 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 18:11:59,232 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 18:11:59,234 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 18:11:59,234 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 18:11:59,235 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 18:11:59,235 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 18:11:59,236 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 564 msec 2023-07-19 18:11:59,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-19 18:11:59,283 INFO [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-19 18:11:59,284 DEBUG [Listener at jenkins-hbase4.apache.org/42301] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testEmptyExportFileSystemState get assigned. Timeout = 60000ms 2023-07-19 18:11:59,284 INFO [Listener at jenkins-hbase4.apache.org/42301] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 18:11:59,290 INFO [Listener at jenkins-hbase4.apache.org/42301] hbase.HBaseTestingUtility(3484): All regions for table testtb-testEmptyExportFileSystemState assigned to meta. Checking AM states. 2023-07-19 18:11:59,291 INFO [Listener at jenkins-hbase4.apache.org/42301] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 18:11:59,291 INFO [Listener at jenkins-hbase4.apache.org/42301] hbase.HBaseTestingUtility(3504): All regions for table testtb-testEmptyExportFileSystemState assigned. 2023-07-19 18:11:59,296 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 18:11:59,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689790319296 (current time:1689790319296). 2023-07-19 18:11:59,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 18:11:59,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] zookeeper.ReadOnlyZKClient(139): Connect 0x07fcebde to 127.0.0.1:51604 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 18:11:59,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@73d51f81, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 18:11:59,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 18:11:59,325 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59928, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 18:11:59,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x07fcebde to 127.0.0.1:51604 2023-07-19 18:11:59,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 18:11:59,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] zookeeper.ReadOnlyZKClient(139): Connect 0x54855dac to 127.0.0.1:51604 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 18:11:59,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3447fef9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 18:11:59,362 DEBUG [hconnection-0x6fb5d6e7-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 18:11:59,364 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59940, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 18:11:59,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x54855dac to 127.0.0.1:51604 2023-07-19 18:11:59,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 18:11:59,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-19 18:11:59,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 18:11:59,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 18:11:59,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-19 18:11:59,388 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-19 18:11:59,389 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689790919389 2023-07-19 18:11:59,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 18:11:59,389 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-19 18:11:59,391 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 18:11:59,391 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 18:11:59,392 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-19 18:11:59,393 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-19 18:11:59,394 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-07-19 18:11:59,398 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-19 18:11:59,402 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689790919402 2023-07-19 18:11:59,457 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:11:59,458 INFO [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-19 18:11:59,458 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 18:11:59,460 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-19 18:11:59,460 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-19 18:11:59,460 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:11:59,460 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:11:59,466 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:11:59,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:11:59,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:11:59,466 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:11:59,466 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:11:59,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:11:59,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:11:59,467 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:59,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:11:59,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:11:59,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:11:59,467 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:59,467 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:59,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:11:59,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:11:59,467 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:11:59,468 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:59,468 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 18:11:59,468 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:11:59,468 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:11:59,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-19 18:11:59,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:11:59,468 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-19 18:11:59,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-19 18:11:59,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:11:59,469 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-19 18:11:59,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-19 18:11:59,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:11:59,469 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-19 18:11:59,472 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:11:59,473 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-19 18:11:59,473 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 18:11:59,474 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:11:59,475 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-19 18:11:59,481 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:11:59,480 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-19 18:11:59,481 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-19 18:11:59,481 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-19 18:11:59,481 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 18:11:59,481 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 18:11:59,481 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33037,1689790219604' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-19 18:11:59,484 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-19 18:11:59,484 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-19 18:11:59,484 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-19 18:11:59,484 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-19 18:11:59,484 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40317,1689790219525' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-19 18:11:59,484 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44407,1689790219668' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-19 18:11:59,485 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:11:59,485 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:59,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:59,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 18:11:59,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 18:11:59,487 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:11:59,487 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:11:59,487 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 18:11:59,487 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:11:59,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 18:11:59,488 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:11:59,488 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 18:11:59,488 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:11:59,488 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:59,488 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 18:11:59,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 18:11:59,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:11:59,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:59,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:59,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:59,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 18:11:59,490 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33037,1689790219604' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-19 18:11:59,490 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5c362181[Count = 1] remaining members to acquire global barrier 2023-07-19 18:11:59,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:59,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 18:11:59,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 18:11:59,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 18:11:59,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 18:11:59,492 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 18:11:59,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:11:59,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:59,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 18:11:59,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 18:11:59,493 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 18:11:59,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:59,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:59,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 18:11:59,494 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40317,1689790219525' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-19 18:11:59,494 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5c362181[Count = 0] remaining members to acquire global barrier 2023-07-19 18:11:59,494 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-19 18:11:59,494 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:11:59,496 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:11:59,496 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:11:59,496 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:11:59,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:11:59,496 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:11:59,496 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-19 18:11:59,496 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:11:59,496 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:11:59,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:11:59,496 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-19 18:11:59,496 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-19 18:11:59,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:11:59,497 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-19 18:11:59,496 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44407,1689790219668' in zk 2023-07-19 18:11:59,497 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:59,497 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:59,497 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 18:11:59,498 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-19 18:11:59,498 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 18:11:59,499 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-19 18:11:59,504 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 18:11:59,511 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689790318670.fdf40efcf427b4e30d1aa31c7701ac80. 2023-07-19 18:11:59,511 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 18:11:59,510 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 18:11:59,511 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 18:11:59,508 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689790318670.349b694c46432a76b92ba931ff230909. 2023-07-19 18:11:59,511 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689790318670.fdf40efcf427b4e30d1aa31c7701ac80. started... 2023-07-19 18:11:59,511 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689790318670.349b694c46432a76b92ba931ff230909. started... 2023-07-19 18:11:59,515 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fdf40efcf427b4e30d1aa31c7701ac80: 2023-07-19 18:11:59,515 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 349b694c46432a76b92ba931ff230909: 2023-07-19 18:11:59,515 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689790318670.fdf40efcf427b4e30d1aa31c7701ac80.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:11:59,515 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689790318670.349b694c46432a76b92ba931ff230909.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:11:59,517 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 18:11:59,517 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 18:11:59,517 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 18:11:59,517 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 18:11:59,573 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689790318670.349b694c46432a76b92ba931ff230909. completed. 2023-07-19 18:11:59,573 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689790318670.349b694c46432a76b92ba931ff230909. 2023-07-19 18:11:59,574 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 18:11:59,574 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 18:11:59,574 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:59,574 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-19 18:11:59,574 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40317,1689790219525' in zk 2023-07-19 18:11:59,578 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689790318670.fdf40efcf427b4e30d1aa31c7701ac80. completed. 2023-07-19 18:11:59,578 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689790318670.fdf40efcf427b4e30d1aa31c7701ac80. 2023-07-19 18:11:59,578 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 18:11:59,578 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 18:11:59,578 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:59,578 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-19 18:11:59,578 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33037,1689790219604' in zk 2023-07-19 18:11:59,578 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:59,578 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-19 18:11:59,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:59,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 18:11:59,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 18:11:59,578 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 18:11:59,579 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-19 18:11:59,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 18:11:59,582 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-19 18:11:59,582 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:59,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 18:11:59,582 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 18:11:59,582 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-19 18:11:59,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:11:59,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:59,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:59,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:59,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 18:11:59,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:11:59,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:59,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:59,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:59,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,40317,1689790219525': 2023-07-19 18:11:59,588 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40317,1689790219525' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-19 18:11:59,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:59,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 18:11:59,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 18:11:59,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 18:11:59,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 18:11:59,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:11:59,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:59,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:59,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:59,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 18:11:59,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:11:59,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:59,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:59,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:59,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,33037,1689790219604': 2023-07-19 18:11:59,592 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33037,1689790219604' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-19 18:11:59,592 INFO [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-19 18:11:59,592 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 18:11:59,592 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 18:11:59,592 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:11:59,592 INFO [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 18:11:59,594 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:11:59,594 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:11:59,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:11:59,595 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:11:59,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:11:59,595 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:11:59,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:11:59,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:11:59,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 18:11:59,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 18:11:59,595 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:11:59,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:11:59,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:11:59,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:11:59,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:11:59,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:11:59,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:11:59,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 18:11:59,596 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:59,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:11:59,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:11:59,597 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:59,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 18:11:59,597 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:59,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:11:59,598 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:11:59,599 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:11:59,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:11:59,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:11:59,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:59,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:11:59,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:11:59,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:11:59,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:59,601 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:59,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:59,601 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:59,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 18:11:59,602 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:59,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:11:59,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:59,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:59,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:59,606 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:11:59,606 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:11:59,606 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:11:59,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:11:59,606 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:59,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:11:59,606 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:11:59,606 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:11:59,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:11:59,606 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:11:59,606 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:11:59,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:11:59,606 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:11:59,606 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:59,606 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:59,606 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:11:59,606 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:11:59,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:11:59,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:11:59,606 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 18:11:59,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:11:59,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:11:59,606 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:11:59,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:11:59,606 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:11:59,607 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:11:59,607 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:11:59,607 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:11:59,607 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:11:59,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:11:59,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:11:59,609 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:11:59,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:11:59,659 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:11:59,693 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 18:11:59,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 18:11:59,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 18:11:59,695 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 18:11:59,730 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-19 18:11:59,730 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:11:59,730 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:11:59,730 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689790319389Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689790319606 (+217 ms)Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689790319606Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689790319612 (+6 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689790319644 (+32 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689790319730 (+86 ms) 2023-07-19 18:11:59,735 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-19 18:11:59,737 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 344 msec 2023-07-19 18:11:59,995 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 18:11:59,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 18:11:59,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 18:12:00,013 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40317] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689790318670.349b694c46432a76b92ba931ff230909. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 18:12:00,022 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33037] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689790318670.fdf40efcf427b4e30d1aa31c7701ac80. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 18:12:00,037 DEBUG [Listener at jenkins-hbase4.apache.org/42301] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-19 18:12:00,037 DEBUG [Listener at jenkins-hbase4.apache.org/42301] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689790318670.fdf40efcf427b4e30d1aa31c7701ac80. 2023-07-19 18:12:00,037 INFO [Listener at jenkins-hbase4.apache.org/42301] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 18:12:00,059 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 18:12:00,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689790320059 (current time:1689790320059). 2023-07-19 18:12:00,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 18:12:00,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] zookeeper.ReadOnlyZKClient(139): Connect 0x29beffc8 to 127.0.0.1:51604 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 18:12:00,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@687d16f6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 18:12:00,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 18:12:00,087 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59956, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 18:12:00,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x29beffc8 to 127.0.0.1:51604 2023-07-19 18:12:00,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 18:12:00,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] zookeeper.ReadOnlyZKClient(139): Connect 0x2457ae8a to 127.0.0.1:51604 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 18:12:00,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7ac94577, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 18:12:00,205 DEBUG [hconnection-0x7a03267e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 18:12:00,210 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59972, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 18:12:00,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2457ae8a to 127.0.0.1:51604 2023-07-19 18:12:00,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 18:12:00,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-19 18:12:00,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 18:12:00,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 18:12:00,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-19 18:12:00,221 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-19 18:12:00,222 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689790920222 2023-07-19 18:12:00,222 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-19 18:12:00,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 18:12:00,222 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 18:12:00,223 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 18:12:00,224 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-19 18:12:00,224 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-19 18:12:00,225 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-07-19 18:12:00,226 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-19 18:12:00,227 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689790920227 2023-07-19 18:12:00,276 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:00,276 INFO [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-19 18:12:00,276 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 18:12:00,278 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-19 18:12:00,278 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-19 18:12:00,279 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:00,279 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:00,280 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:12:00,280 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:12:00,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:12:00,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:12:00,280 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:12:00,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:12:00,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:12:00,281 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:12:00,281 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:12:00,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:00,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:00,281 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:12:00,281 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 18:12:00,281 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:00,281 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:00,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-19 18:12:00,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:00,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-19 18:12:00,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:00,282 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-19 18:12:00,282 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-19 18:12:00,282 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:00,282 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:00,282 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-19 18:12:00,282 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-19 18:12:00,282 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 18:12:00,282 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:12:00,287 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-19 18:12:00,287 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-19 18:12:00,282 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 18:12:00,287 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33037,1689790219604' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-19 18:12:00,289 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-19 18:12:00,289 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-19 18:12:00,289 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44407,1689790219668' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-19 18:12:00,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:12:00,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:12:00,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:00,291 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:00,291 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:00,291 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:00,291 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:00,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-19 18:12:00,291 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 18:12:00,291 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:12:00,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:00,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:12:00,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 18:12:00,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 18:12:00,291 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:00,291 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-19 18:12:00,291 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 18:12:00,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 18:12:00,292 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:00,292 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-19 18:12:00,292 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 18:12:00,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 18:12:00,296 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-19 18:12:00,297 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-19 18:12:00,297 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40317,1689790219525' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-19 18:12:00,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:00,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:12:00,299 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:00,299 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:12:00,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:12:00,299 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:00,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 18:12:00,299 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 18:12:00,299 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33037,1689790219604' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-19 18:12:00,300 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@58fa4c21[Count = 1] remaining members to acquire global barrier 2023-07-19 18:12:00,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:12:00,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 18:12:00,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 18:12:00,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 18:12:00,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 18:12:00,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:00,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:12:00,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:12:00,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:12:00,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 18:12:00,303 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40317,1689790219525' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-19 18:12:00,303 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@58fa4c21[Count = 0] remaining members to acquire global barrier 2023-07-19 18:12:00,303 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-19 18:12:00,303 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:00,311 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:00,311 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:00,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:00,311 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:00,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:00,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:00,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:00,311 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-19 18:12:00,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:00,312 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:12:00,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:00,312 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-19 18:12:00,312 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-19 18:12:00,312 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44407,1689790219668' in zk 2023-07-19 18:12:00,312 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 18:12:00,312 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 18:12:00,312 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:12:00,312 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689790318670.349b694c46432a76b92ba931ff230909. 2023-07-19 18:12:00,312 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-19 18:12:00,312 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689790318670.349b694c46432a76b92ba931ff230909. started... 2023-07-19 18:12:00,312 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 18:12:00,312 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 18:12:00,312 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 18:12:00,313 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689790318670.fdf40efcf427b4e30d1aa31c7701ac80. 2023-07-19 18:12:00,313 INFO [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 349b694c46432a76b92ba931ff230909 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-19 18:12:00,313 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689790318670.fdf40efcf427b4e30d1aa31c7701ac80. started... 2023-07-19 18:12:00,313 INFO [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] regionserver.HRegion(2745): Flushing fdf40efcf427b4e30d1aa31c7701ac80 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-19 18:12:00,314 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-19 18:12:00,314 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 18:12:00,314 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-19 18:12:00,323 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 18:12:00,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 18:12:00,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 18:12:00,325 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 18:12:00,367 INFO [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testEmptyExportFileSystemState/fdf40efcf427b4e30d1aa31c7701ac80/.tmp/cf/b7d2ed4851e44f5180d0fe7fa6ae944a 2023-07-19 18:12:00,367 INFO [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testEmptyExportFileSystemState/349b694c46432a76b92ba931ff230909/.tmp/cf/55e449aff3394cd7b9e6b878f7373b64 2023-07-19 18:12:00,376 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testEmptyExportFileSystemState/fdf40efcf427b4e30d1aa31c7701ac80/.tmp/cf/b7d2ed4851e44f5180d0fe7fa6ae944a as hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testEmptyExportFileSystemState/fdf40efcf427b4e30d1aa31c7701ac80/cf/b7d2ed4851e44f5180d0fe7fa6ae944a 2023-07-19 18:12:00,377 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testEmptyExportFileSystemState/349b694c46432a76b92ba931ff230909/.tmp/cf/55e449aff3394cd7b9e6b878f7373b64 as hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testEmptyExportFileSystemState/349b694c46432a76b92ba931ff230909/cf/55e449aff3394cd7b9e6b878f7373b64 2023-07-19 18:12:00,387 INFO [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testEmptyExportFileSystemState/fdf40efcf427b4e30d1aa31c7701ac80/cf/b7d2ed4851e44f5180d0fe7fa6ae944a, entries=3, sequenceid=6, filesize=5.0 K 2023-07-19 18:12:00,387 INFO [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testEmptyExportFileSystemState/349b694c46432a76b92ba931ff230909/cf/55e449aff3394cd7b9e6b878f7373b64, entries=47, sequenceid=6, filesize=8 K 2023-07-19 18:12:00,388 INFO [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for fdf40efcf427b4e30d1aa31c7701ac80 in 75ms, sequenceid=6, compaction requested=false 2023-07-19 18:12:00,388 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-19 18:12:00,389 INFO [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 349b694c46432a76b92ba931ff230909 in 76ms, sequenceid=6, compaction requested=false 2023-07-19 18:12:00,389 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-19 18:12:00,393 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 349b694c46432a76b92ba931ff230909: 2023-07-19 18:12:00,393 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fdf40efcf427b4e30d1aa31c7701ac80: 2023-07-19 18:12:00,393 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689790318670.349b694c46432a76b92ba931ff230909.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:00,393 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689790318670.fdf40efcf427b4e30d1aa31c7701ac80.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:00,394 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 18:12:00,395 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 18:12:00,395 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testEmptyExportFileSystemState/349b694c46432a76b92ba931ff230909/cf/55e449aff3394cd7b9e6b878f7373b64] hfiles 2023-07-19 18:12:00,395 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testEmptyExportFileSystemState/fdf40efcf427b4e30d1aa31c7701ac80/cf/b7d2ed4851e44f5180d0fe7fa6ae944a] hfiles 2023-07-19 18:12:00,395 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testEmptyExportFileSystemState/fdf40efcf427b4e30d1aa31c7701ac80/cf/b7d2ed4851e44f5180d0fe7fa6ae944a for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:00,395 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testEmptyExportFileSystemState/349b694c46432a76b92ba931ff230909/cf/55e449aff3394cd7b9e6b878f7373b64 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:00,427 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689790318670.349b694c46432a76b92ba931ff230909. completed. 2023-07-19 18:12:00,427 DEBUG [rs(jenkins-hbase4.apache.org,40317,1689790219525)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689790318670.349b694c46432a76b92ba931ff230909. 2023-07-19 18:12:00,427 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 18:12:00,427 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 18:12:00,427 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:12:00,431 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-19 18:12:00,431 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40317,1689790219525' in zk 2023-07-19 18:12:00,433 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:12:00,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:12:00,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 18:12:00,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 18:12:00,433 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-19 18:12:00,433 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 18:12:00,433 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-19 18:12:00,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 18:12:00,436 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689790318670.fdf40efcf427b4e30d1aa31c7701ac80. completed. 2023-07-19 18:12:00,436 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689790318670.fdf40efcf427b4e30d1aa31c7701ac80. 2023-07-19 18:12:00,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 18:12:00,436 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 18:12:00,436 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 18:12:00,436 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:12:00,437 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-19 18:12:00,437 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33037,1689790219604' in zk 2023-07-19 18:12:00,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:00,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:12:00,438 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:12:00,438 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-19 18:12:00,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:12:00,438 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 18:12:00,439 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-19 18:12:00,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:12:00,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 18:12:00,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:00,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:12:00,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:12:00,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:12:00,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,40317,1689790219525': 2023-07-19 18:12:00,444 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40317,1689790219525' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-19 18:12:00,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:12:00,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 18:12:00,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 18:12:00,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 18:12:00,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 18:12:00,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:00,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:12:00,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:12:00,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:12:00,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 18:12:00,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:00,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:12:00,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:12:00,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:12:00,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,33037,1689790219604': 2023-07-19 18:12:00,449 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33037,1689790219604' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-19 18:12:00,449 INFO [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-19 18:12:00,449 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 18:12:00,449 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 18:12:00,449 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:00,449 INFO [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 18:12:00,452 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:00,452 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:00,452 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:00,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:00,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:00,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:00,452 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:00,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:00,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:00,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:00,452 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:12:00,452 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:12:00,452 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:12:00,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:12:00,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:12:00,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:00,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 18:12:00,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 18:12:00,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:12:00,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:12:00,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:12:00,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:12:00,453 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:12:00,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:00,453 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:12:00,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 18:12:00,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:00,454 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:12:00,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:00,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:00,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 18:12:00,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:00,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:12:00,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:12:00,457 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:12:00,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:12:00,458 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:12:00,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 18:12:00,458 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:12:00,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:00,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:12:00,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:12:00,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:12:00,462 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:12:00,462 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:12:00,462 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:12:00,462 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:12:00,462 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:12:00,462 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:12:00,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:12:00,462 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:12:00,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:12:00,462 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:12:00,462 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 18:12:00,462 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:00,462 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:00,462 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:12:00,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:12:00,462 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:12:00,465 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:00,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:12:00,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:12:00,465 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:12:00,466 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:12:00,466 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:00,466 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:12:00,466 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:00,466 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:12:00,466 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:12:00,466 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:00,466 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:00,467 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:00,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:12:00,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:12:00,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:12:00,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:12:00,498 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:00,525 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 18:12:00,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 18:12:00,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 18:12:00,527 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 18:12:00,534 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-19 18:12:00,534 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:00,534 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:00,535 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689790320222Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689790320465 (+243 ms)Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689790320466 (+1 ms)Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689790320470 (+4 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689790320492 (+22 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689790320534 (+42 ms) 2023-07-19 18:12:00,539 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-19 18:12:00,541 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 317 msec 2023-07-19 18:12:00,827 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 18:12:00,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 18:12:00,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 18:12:00,829 INFO [Listener at jenkins-hbase4.apache.org/42301] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/export-test/export-1689790320829 2023-07-19 18:12:00,829 INFO [Listener at jenkins-hbase4.apache.org/42301] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:40881, tgtDir=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/export-test/export-1689790320829, rawTgtDir=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/export-test/export-1689790320829, srcFsUri=hdfs://localhost:40881, srcDir=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf 2023-07-19 18:12:00,864 DEBUG [Listener at jenkins-hbase4.apache.org/42301] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:40881, inputRoot=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf 2023-07-19 18:12:00,865 DEBUG [Listener at jenkins-hbase4.apache.org/42301] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1190673796_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/export-test/export-1689790320829, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/export-test/export-1689790320829/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:00,865 INFO [Listener at jenkins-hbase4.apache.org/42301] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:40881, inputRoot=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf, snapshotDir=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-19 18:12:00,871 INFO [Listener at jenkins-hbase4.apache.org/42301] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/export-test/export-1689790320829/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:00,902 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 18:12:00,903 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 18:12:00,903 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 18:12:00,904 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 18:12:00,904 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-19 18:12:00,904 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 18:12:00,904 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 18:12:00,974 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/hadoop-1256075599233306107.jar 2023-07-19 18:12:00,975 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 18:12:00,975 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 18:12:00,976 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 18:12:00,976 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 18:12:00,976 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 18:12:00,976 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 18:12:00,977 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 18:12:00,977 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 18:12:00,977 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 18:12:00,978 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 18:12:00,978 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 18:12:00,979 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 18:12:00,979 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 18:12:00,979 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 18:12:00,980 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 18:12:00,980 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 18:12:00,980 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 18:12:00,981 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 18:12:00,981 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 18:12:00,981 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 18:12:00,981 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 18:12:00,982 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 18:12:00,982 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 18:12:02,017 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689790227140_0005_000001 (auth:SIMPLE) 2023-07-19 18:12:02,369 WARN [Listener at jenkins-hbase4.apache.org/42301] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 18:12:02,372 INFO [Listener at jenkins-hbase4.apache.org/42301] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-19 18:12:02,473 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 18:12:02,473 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 18:12:03,019 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689790227140_0006_000001 (auth:SIMPLE) 2023-07-19 18:12:03,509 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 18:12:09,021 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689790227140_0006_000001 (auth:SIMPLE) 2023-07-19 18:12:11,836 INFO [Listener at jenkins-hbase4.apache.org/42301] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 18:12:11,837 INFO [Listener at jenkins-hbase4.apache.org/42301] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 18:12:11,885 INFO [Listener at jenkins-hbase4.apache.org/42301] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:11,886 INFO [Listener at jenkins-hbase4.apache.org/42301] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 18:12:11,888 INFO [Listener at jenkins-hbase4.apache.org/42301] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 18:12:11,888 DEBUG [Listener at jenkins-hbase4.apache.org/42301] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2119224145_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:11,889 DEBUG [Listener at jenkins-hbase4.apache.org/42301] snapshot.TestExportSnapshot(367): hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-19 18:12:11,889 DEBUG [Listener at jenkins-hbase4.apache.org/42301] snapshot.TestExportSnapshot(367): hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-19 18:12:11,889 DEBUG [Listener at jenkins-hbase4.apache.org/42301] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2119224145_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/export-test/export-1689790320829/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/export-test/export-1689790320829/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:11,891 DEBUG [Listener at jenkins-hbase4.apache.org/42301] snapshot.TestExportSnapshot(367): hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/export-test/export-1689790320829/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-19 18:12:11,891 DEBUG [Listener at jenkins-hbase4.apache.org/42301] snapshot.TestExportSnapshot(367): hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/export-test/export-1689790320829/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-19 18:12:11,907 INFO [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-19 18:12:11,908 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-19 18:12:11,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 18:12:11,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-19 18:12:11,923 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689790331923"}]},"ts":"1689790331923"} 2023-07-19 18:12:11,926 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-19 18:12:11,927 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-19 18:12:11,929 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=fdf40efcf427b4e30d1aa31c7701ac80, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=349b694c46432a76b92ba931ff230909, UNASSIGN}] 2023-07-19 18:12:11,931 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=349b694c46432a76b92ba931ff230909, UNASSIGN 2023-07-19 18:12:11,931 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=fdf40efcf427b4e30d1aa31c7701ac80, UNASSIGN 2023-07-19 18:12:11,933 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=349b694c46432a76b92ba931ff230909, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:12:11,933 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=fdf40efcf427b4e30d1aa31c7701ac80, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:12:11,933 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689790318670.349b694c46432a76b92ba931ff230909.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689790331933"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689790331933"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689790331933"}]},"ts":"1689790331933"} 2023-07-19 18:12:11,933 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689790318670.fdf40efcf427b4e30d1aa31c7701ac80.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689790331933"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689790331933"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689790331933"}]},"ts":"1689790331933"} 2023-07-19 18:12:11,935 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=101, state=RUNNABLE; CloseRegionProcedure 349b694c46432a76b92ba931ff230909, server=jenkins-hbase4.apache.org,40317,1689790219525}] 2023-07-19 18:12:11,936 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; CloseRegionProcedure fdf40efcf427b4e30d1aa31c7701ac80, server=jenkins-hbase4.apache.org,33037,1689790219604}] 2023-07-19 18:12:12,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-19 18:12:12,089 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close fdf40efcf427b4e30d1aa31c7701ac80 2023-07-19 18:12:12,089 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing fdf40efcf427b4e30d1aa31c7701ac80, disabling compactions & flushes 2023-07-19 18:12:12,089 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689790318670.fdf40efcf427b4e30d1aa31c7701ac80. 2023-07-19 18:12:12,089 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689790318670.fdf40efcf427b4e30d1aa31c7701ac80. 2023-07-19 18:12:12,089 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689790318670.fdf40efcf427b4e30d1aa31c7701ac80. after waiting 0 ms 2023-07-19 18:12:12,089 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689790318670.fdf40efcf427b4e30d1aa31c7701ac80. 2023-07-19 18:12:12,089 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 349b694c46432a76b92ba931ff230909 2023-07-19 18:12:12,089 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 349b694c46432a76b92ba931ff230909, disabling compactions & flushes 2023-07-19 18:12:12,089 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689790318670.349b694c46432a76b92ba931ff230909. 2023-07-19 18:12:12,089 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689790318670.349b694c46432a76b92ba931ff230909. 2023-07-19 18:12:12,089 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689790318670.349b694c46432a76b92ba931ff230909. after waiting 0 ms 2023-07-19 18:12:12,089 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689790318670.349b694c46432a76b92ba931ff230909. 2023-07-19 18:12:12,119 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testEmptyExportFileSystemState/fdf40efcf427b4e30d1aa31c7701ac80/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 18:12:12,119 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 18:12:12,122 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689790318670.fdf40efcf427b4e30d1aa31c7701ac80. 2023-07-19 18:12:12,122 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for fdf40efcf427b4e30d1aa31c7701ac80: 2023-07-19 18:12:12,124 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed fdf40efcf427b4e30d1aa31c7701ac80 2023-07-19 18:12:12,124 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=fdf40efcf427b4e30d1aa31c7701ac80, regionState=CLOSED 2023-07-19 18:12:12,125 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689790318670.fdf40efcf427b4e30d1aa31c7701ac80.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689790332124"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689790332124"}]},"ts":"1689790332124"} 2023-07-19 18:12:12,129 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=100 2023-07-19 18:12:12,129 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=100, state=SUCCESS; CloseRegionProcedure fdf40efcf427b4e30d1aa31c7701ac80, server=jenkins-hbase4.apache.org,33037,1689790219604 in 191 msec 2023-07-19 18:12:12,130 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=fdf40efcf427b4e30d1aa31c7701ac80, UNASSIGN in 200 msec 2023-07-19 18:12:12,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testEmptyExportFileSystemState/349b694c46432a76b92ba931ff230909/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 18:12:12,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 18:12:12,134 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689790318670.349b694c46432a76b92ba931ff230909. 2023-07-19 18:12:12,135 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 349b694c46432a76b92ba931ff230909: 2023-07-19 18:12:12,137 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 349b694c46432a76b92ba931ff230909 2023-07-19 18:12:12,138 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=349b694c46432a76b92ba931ff230909, regionState=CLOSED 2023-07-19 18:12:12,138 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689790318670.349b694c46432a76b92ba931ff230909.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689790332137"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689790332137"}]},"ts":"1689790332137"} 2023-07-19 18:12:12,142 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=101 2023-07-19 18:12:12,142 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=101, state=SUCCESS; CloseRegionProcedure 349b694c46432a76b92ba931ff230909, server=jenkins-hbase4.apache.org,40317,1689790219525 in 204 msec 2023-07-19 18:12:12,144 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-07-19 18:12:12,144 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=349b694c46432a76b92ba931ff230909, UNASSIGN in 213 msec 2023-07-19 18:12:12,145 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689790332145"}]},"ts":"1689790332145"} 2023-07-19 18:12:12,146 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-19 18:12:12,148 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-19 18:12:12,152 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 243 msec 2023-07-19 18:12:12,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-19 18:12:12,223 INFO [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-19 18:12:12,224 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-19 18:12:12,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 18:12:12,234 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 18:12:12,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-19 18:12:12,235 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 18:12:12,237 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33037] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-19 18:12:12,240 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 18:12:12,240 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 18:12:12,241 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 18:12:12,241 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 18:12:12,241 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-19 18:12:12,242 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-19 18:12:12,242 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-19 18:12:12,242 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-19 18:12:12,242 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testEmptyExportFileSystemState/349b694c46432a76b92ba931ff230909 2023-07-19 18:12:12,243 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testEmptyExportFileSystemState/fdf40efcf427b4e30d1aa31c7701ac80 2023-07-19 18:12:12,243 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 18:12:12,243 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 18:12:12,243 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 18:12:12,244 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 18:12:12,243 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 18:12:12,244 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 18:12:12,244 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 18:12:12,243 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 18:12:12,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-19 18:12:12,247 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testEmptyExportFileSystemState/349b694c46432a76b92ba931ff230909/cf, FileablePath, hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testEmptyExportFileSystemState/349b694c46432a76b92ba931ff230909/recovered.edits] 2023-07-19 18:12:12,250 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testEmptyExportFileSystemState/fdf40efcf427b4e30d1aa31c7701ac80/cf, FileablePath, hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testEmptyExportFileSystemState/fdf40efcf427b4e30d1aa31c7701ac80/recovered.edits] 2023-07-19 18:12:12,253 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testEmptyExportFileSystemState/349b694c46432a76b92ba931ff230909/cf/55e449aff3394cd7b9e6b878f7373b64 to hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/archive/data/default/testtb-testEmptyExportFileSystemState/349b694c46432a76b92ba931ff230909/cf/55e449aff3394cd7b9e6b878f7373b64 2023-07-19 18:12:12,262 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testEmptyExportFileSystemState/349b694c46432a76b92ba931ff230909/recovered.edits/9.seqid to hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/archive/data/default/testtb-testEmptyExportFileSystemState/349b694c46432a76b92ba931ff230909/recovered.edits/9.seqid 2023-07-19 18:12:12,263 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testEmptyExportFileSystemState/349b694c46432a76b92ba931ff230909 2023-07-19 18:12:12,282 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testEmptyExportFileSystemState/fdf40efcf427b4e30d1aa31c7701ac80/cf/b7d2ed4851e44f5180d0fe7fa6ae944a to hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/archive/data/default/testtb-testEmptyExportFileSystemState/fdf40efcf427b4e30d1aa31c7701ac80/cf/b7d2ed4851e44f5180d0fe7fa6ae944a 2023-07-19 18:12:12,287 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testEmptyExportFileSystemState/fdf40efcf427b4e30d1aa31c7701ac80/recovered.edits/9.seqid to hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/archive/data/default/testtb-testEmptyExportFileSystemState/fdf40efcf427b4e30d1aa31c7701ac80/recovered.edits/9.seqid 2023-07-19 18:12:12,288 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testEmptyExportFileSystemState/fdf40efcf427b4e30d1aa31c7701ac80 2023-07-19 18:12:12,288 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-19 18:12:12,291 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 18:12:12,307 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-19 18:12:12,329 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-19 18:12:12,331 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 18:12:12,331 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-19 18:12:12,331 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689790318670.fdf40efcf427b4e30d1aa31c7701ac80.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689790332331"}]},"ts":"9223372036854775807"} 2023-07-19 18:12:12,331 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689790318670.349b694c46432a76b92ba931ff230909.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689790332331"}]},"ts":"9223372036854775807"} 2023-07-19 18:12:12,341 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-19 18:12:12,341 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => fdf40efcf427b4e30d1aa31c7701ac80, NAME => 'testtb-testEmptyExportFileSystemState,,1689790318670.fdf40efcf427b4e30d1aa31c7701ac80.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 349b694c46432a76b92ba931ff230909, NAME => 'testtb-testEmptyExportFileSystemState,1,1689790318670.349b694c46432a76b92ba931ff230909.', STARTKEY => '1', ENDKEY => ''}] 2023-07-19 18:12:12,341 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-19 18:12:12,341 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689790332341"}]},"ts":"9223372036854775807"} 2023-07-19 18:12:12,344 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-19 18:12:12,346 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 18:12:12,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-19 18:12:12,348 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 122 msec 2023-07-19 18:12:12,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-19 18:12:12,549 INFO [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-19 18:12:12,560 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-19 18:12:12,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:12,564 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-19 18:12:12,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-19 18:12:12,600 INFO [Listener at jenkins-hbase4.apache.org/42301] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=766 (was 762) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-366081297_1 at /127.0.0.1:54230 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3af1d18e-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2119224145_17 at /127.0.0.1:49724 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3af1d18e-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1477432893) connection to jenkins-hbase4.apache.org/172.31.14.131:42301 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1477432893) connection to jenkins-hbase4.apache.org/172.31.14.131:41011 from appattempt_1689790227140_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-366081297_1 at /127.0.0.1:52356 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2119224145_17 at /127.0.0.1:40416 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2119224145_17 at /127.0.0.1:45924 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3af1d18e-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3af1d18e-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4715 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1477432893) connection to jenkins-hbase4.apache.org/172.31.14.131:42689 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=905 (was 905), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=743 (was 660) - SystemLoadAverage LEAK? -, ProcessCount=185 (was 188), AvailableMemoryMB=1901 (was 2481) 2023-07-19 18:12:12,601 WARN [Listener at jenkins-hbase4.apache.org/42301] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-07-19 18:12:12,633 INFO [Listener at jenkins-hbase4.apache.org/42301] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=766, OpenFileDescriptor=905, MaxFileDescriptor=60000, SystemLoadAverage=743, ProcessCount=185, AvailableMemoryMB=1897 2023-07-19 18:12:12,633 WARN [Listener at jenkins-hbase4.apache.org/42301] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-07-19 18:12:12,635 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-19 18:12:12,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:12,639 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 18:12:12,639 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-19 18:12:12,640 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 18:12:12,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-19 18:12:12,642 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/25c95e9f1d57c1e8753bb4a2daf0eb9d 2023-07-19 18:12:12,642 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5059f0ddd6154c1c238e4f4b756556c1 2023-07-19 18:12:12,643 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/25c95e9f1d57c1e8753bb4a2daf0eb9d empty. 2023-07-19 18:12:12,643 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5059f0ddd6154c1c238e4f4b756556c1 empty. 2023-07-19 18:12:12,644 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/25c95e9f1d57c1e8753bb4a2daf0eb9d 2023-07-19 18:12:12,644 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5059f0ddd6154c1c238e4f4b756556c1 2023-07-19 18:12:12,644 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-19 18:12:12,674 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-19 18:12:12,692 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 25c95e9f1d57c1e8753bb4a2daf0eb9d, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689790332634.25c95e9f1d57c1e8753bb4a2daf0eb9d.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp 2023-07-19 18:12:12,694 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 5059f0ddd6154c1c238e4f4b756556c1, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689790332634.5059f0ddd6154c1c238e4f4b756556c1.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp 2023-07-19 18:12:12,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-19 18:12:12,811 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689790332634.5059f0ddd6154c1c238e4f4b756556c1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 18:12:12,813 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 5059f0ddd6154c1c238e4f4b756556c1, disabling compactions & flushes 2023-07-19 18:12:12,813 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689790332634.5059f0ddd6154c1c238e4f4b756556c1. 2023-07-19 18:12:12,813 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689790332634.5059f0ddd6154c1c238e4f4b756556c1. 2023-07-19 18:12:12,813 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689790332634.5059f0ddd6154c1c238e4f4b756556c1. after waiting 0 ms 2023-07-19 18:12:12,813 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689790332634.5059f0ddd6154c1c238e4f4b756556c1. 2023-07-19 18:12:12,813 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689790332634.5059f0ddd6154c1c238e4f4b756556c1. 2023-07-19 18:12:12,813 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 5059f0ddd6154c1c238e4f4b756556c1: 2023-07-19 18:12:12,823 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689790332634.25c95e9f1d57c1e8753bb4a2daf0eb9d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 18:12:12,823 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 25c95e9f1d57c1e8753bb4a2daf0eb9d, disabling compactions & flushes 2023-07-19 18:12:12,823 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689790332634.25c95e9f1d57c1e8753bb4a2daf0eb9d. 2023-07-19 18:12:12,823 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689790332634.25c95e9f1d57c1e8753bb4a2daf0eb9d. 2023-07-19 18:12:12,823 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689790332634.25c95e9f1d57c1e8753bb4a2daf0eb9d. after waiting 0 ms 2023-07-19 18:12:12,823 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689790332634.25c95e9f1d57c1e8753bb4a2daf0eb9d. 2023-07-19 18:12:12,823 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689790332634.25c95e9f1d57c1e8753bb4a2daf0eb9d. 2023-07-19 18:12:12,823 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 25c95e9f1d57c1e8753bb4a2daf0eb9d: 2023-07-19 18:12:12,826 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 18:12:12,827 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689790332634.5059f0ddd6154c1c238e4f4b756556c1.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689790332827"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689790332827"}]},"ts":"1689790332827"} 2023-07-19 18:12:12,827 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689790332634.25c95e9f1d57c1e8753bb4a2daf0eb9d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689790332827"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689790332827"}]},"ts":"1689790332827"} 2023-07-19 18:12:12,830 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 18:12:12,831 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 18:12:12,831 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689790332831"}]},"ts":"1689790332831"} 2023-07-19 18:12:12,833 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-19 18:12:12,842 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 18:12:12,844 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 18:12:12,844 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 18:12:12,844 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 18:12:12,844 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 18:12:12,844 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=25c95e9f1d57c1e8753bb4a2daf0eb9d, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=5059f0ddd6154c1c238e4f4b756556c1, ASSIGN}] 2023-07-19 18:12:12,848 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=25c95e9f1d57c1e8753bb4a2daf0eb9d, ASSIGN 2023-07-19 18:12:12,848 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=5059f0ddd6154c1c238e4f4b756556c1, ASSIGN 2023-07-19 18:12:12,849 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=25c95e9f1d57c1e8753bb4a2daf0eb9d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33037,1689790219604; forceNewPlan=false, retain=false 2023-07-19 18:12:12,849 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=5059f0ddd6154c1c238e4f4b756556c1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44407,1689790219668; forceNewPlan=false, retain=false 2023-07-19 18:12:12,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-19 18:12:12,999 INFO [jenkins-hbase4:40453] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 18:12:13,004 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=25c95e9f1d57c1e8753bb4a2daf0eb9d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:12:13,004 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=5059f0ddd6154c1c238e4f4b756556c1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:12:13,004 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689790332634.25c95e9f1d57c1e8753bb4a2daf0eb9d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689790333004"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689790333004"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689790333004"}]},"ts":"1689790333004"} 2023-07-19 18:12:13,004 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689790332634.5059f0ddd6154c1c238e4f4b756556c1.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689790333004"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689790333004"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689790333004"}]},"ts":"1689790333004"} 2023-07-19 18:12:13,011 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure 25c95e9f1d57c1e8753bb4a2daf0eb9d, server=jenkins-hbase4.apache.org,33037,1689790219604}] 2023-07-19 18:12:13,012 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 5059f0ddd6154c1c238e4f4b756556c1, server=jenkins-hbase4.apache.org,44407,1689790219668}] 2023-07-19 18:12:13,172 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689790332634.25c95e9f1d57c1e8753bb4a2daf0eb9d. 2023-07-19 18:12:13,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 25c95e9f1d57c1e8753bb4a2daf0eb9d, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689790332634.25c95e9f1d57c1e8753bb4a2daf0eb9d.', STARTKEY => '', ENDKEY => '1'} 2023-07-19 18:12:13,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689790332634.25c95e9f1d57c1e8753bb4a2daf0eb9d. service=AccessControlService 2023-07-19 18:12:13,173 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 18:12:13,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 25c95e9f1d57c1e8753bb4a2daf0eb9d 2023-07-19 18:12:13,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689790332634.25c95e9f1d57c1e8753bb4a2daf0eb9d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 18:12:13,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 25c95e9f1d57c1e8753bb4a2daf0eb9d 2023-07-19 18:12:13,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 25c95e9f1d57c1e8753bb4a2daf0eb9d 2023-07-19 18:12:13,175 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689790332634.5059f0ddd6154c1c238e4f4b756556c1. 2023-07-19 18:12:13,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5059f0ddd6154c1c238e4f4b756556c1, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689790332634.5059f0ddd6154c1c238e4f4b756556c1.', STARTKEY => '1', ENDKEY => ''} 2023-07-19 18:12:13,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689790332634.5059f0ddd6154c1c238e4f4b756556c1. service=AccessControlService 2023-07-19 18:12:13,175 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 18:12:13,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 5059f0ddd6154c1c238e4f4b756556c1 2023-07-19 18:12:13,175 INFO [StoreOpener-25c95e9f1d57c1e8753bb4a2daf0eb9d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 25c95e9f1d57c1e8753bb4a2daf0eb9d 2023-07-19 18:12:13,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689790332634.5059f0ddd6154c1c238e4f4b756556c1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 18:12:13,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5059f0ddd6154c1c238e4f4b756556c1 2023-07-19 18:12:13,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5059f0ddd6154c1c238e4f4b756556c1 2023-07-19 18:12:13,177 INFO [StoreOpener-5059f0ddd6154c1c238e4f4b756556c1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5059f0ddd6154c1c238e4f4b756556c1 2023-07-19 18:12:13,177 DEBUG [StoreOpener-25c95e9f1d57c1e8753bb4a2daf0eb9d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithSkipTmp/25c95e9f1d57c1e8753bb4a2daf0eb9d/cf 2023-07-19 18:12:13,177 DEBUG [StoreOpener-25c95e9f1d57c1e8753bb4a2daf0eb9d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithSkipTmp/25c95e9f1d57c1e8753bb4a2daf0eb9d/cf 2023-07-19 18:12:13,178 INFO [StoreOpener-25c95e9f1d57c1e8753bb4a2daf0eb9d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 25c95e9f1d57c1e8753bb4a2daf0eb9d columnFamilyName cf 2023-07-19 18:12:13,178 INFO [StoreOpener-25c95e9f1d57c1e8753bb4a2daf0eb9d-1] regionserver.HStore(310): Store=25c95e9f1d57c1e8753bb4a2daf0eb9d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 18:12:13,178 DEBUG [StoreOpener-5059f0ddd6154c1c238e4f4b756556c1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithSkipTmp/5059f0ddd6154c1c238e4f4b756556c1/cf 2023-07-19 18:12:13,178 DEBUG [StoreOpener-5059f0ddd6154c1c238e4f4b756556c1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithSkipTmp/5059f0ddd6154c1c238e4f4b756556c1/cf 2023-07-19 18:12:13,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithSkipTmp/25c95e9f1d57c1e8753bb4a2daf0eb9d 2023-07-19 18:12:13,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithSkipTmp/25c95e9f1d57c1e8753bb4a2daf0eb9d 2023-07-19 18:12:13,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 25c95e9f1d57c1e8753bb4a2daf0eb9d 2023-07-19 18:12:13,182 INFO [StoreOpener-5059f0ddd6154c1c238e4f4b756556c1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5059f0ddd6154c1c238e4f4b756556c1 columnFamilyName cf 2023-07-19 18:12:13,183 INFO [StoreOpener-5059f0ddd6154c1c238e4f4b756556c1-1] regionserver.HStore(310): Store=5059f0ddd6154c1c238e4f4b756556c1/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 18:12:13,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithSkipTmp/5059f0ddd6154c1c238e4f4b756556c1 2023-07-19 18:12:13,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithSkipTmp/5059f0ddd6154c1c238e4f4b756556c1 2023-07-19 18:12:13,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithSkipTmp/25c95e9f1d57c1e8753bb4a2daf0eb9d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 18:12:13,185 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 25c95e9f1d57c1e8753bb4a2daf0eb9d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72671193, jitterRate=0.08288516104221344}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 18:12:13,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 25c95e9f1d57c1e8753bb4a2daf0eb9d: 2023-07-19 18:12:13,186 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689790332634.25c95e9f1d57c1e8753bb4a2daf0eb9d., pid=108, masterSystemTime=1689790333164 2023-07-19 18:12:13,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689790332634.25c95e9f1d57c1e8753bb4a2daf0eb9d. 2023-07-19 18:12:13,188 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689790332634.25c95e9f1d57c1e8753bb4a2daf0eb9d. 2023-07-19 18:12:13,188 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=25c95e9f1d57c1e8753bb4a2daf0eb9d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:12:13,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5059f0ddd6154c1c238e4f4b756556c1 2023-07-19 18:12:13,188 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689790332634.25c95e9f1d57c1e8753bb4a2daf0eb9d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689790333188"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689790333188"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689790333188"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689790333188"}]},"ts":"1689790333188"} 2023-07-19 18:12:13,191 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithSkipTmp/5059f0ddd6154c1c238e4f4b756556c1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 18:12:13,192 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5059f0ddd6154c1c238e4f4b756556c1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60154850, jitterRate=-0.10362288355827332}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 18:12:13,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5059f0ddd6154c1c238e4f4b756556c1: 2023-07-19 18:12:13,192 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689790332634.5059f0ddd6154c1c238e4f4b756556c1., pid=109, masterSystemTime=1689790333164 2023-07-19 18:12:13,193 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=106 2023-07-19 18:12:13,193 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure 25c95e9f1d57c1e8753bb4a2daf0eb9d, server=jenkins-hbase4.apache.org,33037,1689790219604 in 180 msec 2023-07-19 18:12:13,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689790332634.5059f0ddd6154c1c238e4f4b756556c1. 2023-07-19 18:12:13,194 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689790332634.5059f0ddd6154c1c238e4f4b756556c1. 2023-07-19 18:12:13,194 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=25c95e9f1d57c1e8753bb4a2daf0eb9d, ASSIGN in 349 msec 2023-07-19 18:12:13,194 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=5059f0ddd6154c1c238e4f4b756556c1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:12:13,195 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689790332634.5059f0ddd6154c1c238e4f4b756556c1.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689790333194"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689790333194"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689790333194"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689790333194"}]},"ts":"1689790333194"} 2023-07-19 18:12:13,198 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=107 2023-07-19 18:12:13,198 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 5059f0ddd6154c1c238e4f4b756556c1, server=jenkins-hbase4.apache.org,44407,1689790219668 in 184 msec 2023-07-19 18:12:13,200 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=107, resume processing ppid=105 2023-07-19 18:12:13,200 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=5059f0ddd6154c1c238e4f4b756556c1, ASSIGN in 354 msec 2023-07-19 18:12:13,201 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 18:12:13,201 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689790333201"}]},"ts":"1689790333201"} 2023-07-19 18:12:13,203 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-19 18:12:13,205 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 18:12:13,205 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-19 18:12:13,207 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33037] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-19 18:12:13,209 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 18:12:13,209 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 18:12:13,209 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 18:12:13,209 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 18:12:13,210 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-19 18:12:13,210 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-19 18:12:13,210 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-19 18:12:13,211 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-19 18:12:13,212 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 576 msec 2023-07-19 18:12:13,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-19 18:12:13,245 INFO [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-19 18:12:13,245 DEBUG [Listener at jenkins-hbase4.apache.org/42301] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithSkipTmp get assigned. Timeout = 60000ms 2023-07-19 18:12:13,245 INFO [Listener at jenkins-hbase4.apache.org/42301] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 18:12:13,248 INFO [Listener at jenkins-hbase4.apache.org/42301] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned to meta. Checking AM states. 2023-07-19 18:12:13,248 INFO [Listener at jenkins-hbase4.apache.org/42301] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 18:12:13,249 INFO [Listener at jenkins-hbase4.apache.org/42301] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned. 2023-07-19 18:12:13,252 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-19 18:12:13,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689790333252 (current time:1689790333252). 2023-07-19 18:12:13,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 18:12:13,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] zookeeper.ReadOnlyZKClient(139): Connect 0x5cca6fc3 to 127.0.0.1:51604 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 18:12:13,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@77f8b07f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 18:12:13,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 18:12:13,269 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45674, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 18:12:13,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5cca6fc3 to 127.0.0.1:51604 2023-07-19 18:12:13,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 18:12:13,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] zookeeper.ReadOnlyZKClient(139): Connect 0x6eadbca9 to 127.0.0.1:51604 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 18:12:13,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@619672c8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 18:12:13,297 DEBUG [hconnection-0x53df5dcd-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 18:12:13,301 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45690, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 18:12:13,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6eadbca9 to 127.0.0.1:51604 2023-07-19 18:12:13,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 18:12:13,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-19 18:12:13,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 18:12:13,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-19 18:12:13,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-19 18:12:13,320 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-19 18:12:13,321 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689790933321 2023-07-19 18:12:13,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-19 18:12:13,321 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:13,323 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 18:12:13,323 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 18:12:13,324 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-19 18:12:13,324 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-19 18:12:13,325 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 7 msec 2023-07-19 18:12:13,326 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-19 18:12:13,327 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689790933327 2023-07-19 18:12:13,343 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:13,343 INFO [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-19 18:12:13,343 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 18:12:13,344 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-19 18:12:13,344 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-19 18:12:13,345 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:13,345 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:13,348 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:12:13,348 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:12:13,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:12:13,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:12:13,348 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:12:13,348 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:12:13,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:12:13,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:12:13,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:12:13,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:12:13,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:13,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:13,349 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:13,349 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:13,351 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:12:13,351 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:12:13,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-19 18:12:13,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:13,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:13,351 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-19 18:12:13,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-19 18:12:13,353 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:12:13,353 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 18:12:13,353 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:13,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:13,353 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-19 18:12:13,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-19 18:12:13,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:13,354 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-19 18:12:13,358 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:13,359 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-19 18:12:13,359 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 18:12:13,362 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:13,365 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:13,364 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-19 18:12:13,365 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-19 18:12:13,365 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44407,1689790219668' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-19 18:12:13,365 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-19 18:12:13,365 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 18:12:13,365 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-19 18:12:13,366 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 18:12:13,367 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-19 18:12:13,367 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-19 18:12:13,367 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-19 18:12:13,368 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-19 18:12:13,367 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33037,1689790219604' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-19 18:12:13,368 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40317,1689790219525' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-19 18:12:13,374 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:13,374 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:12:13,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:12:13,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 18:12:13,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 18:12:13,374 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:12:13,374 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:13,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 18:12:13,375 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:13,375 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:13,375 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 18:12:13,377 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:13,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 18:12:13,377 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:13,377 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 18:12:13,377 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 18:12:13,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:13,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:12:13,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:12:13,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:12:13,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 18:12:13,379 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33037,1689790219604' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-19 18:12:13,379 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5b038572[Count = 1] remaining members to acquire global barrier 2023-07-19 18:12:13,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:12:13,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 18:12:13,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 18:12:13,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 18:12:13,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 18:12:13,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:13,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:12:13,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:12:13,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:12:13,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 18:12:13,382 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44407,1689790219668' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-19 18:12:13,382 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5b038572[Count = 0] remaining members to acquire global barrier 2023-07-19 18:12:13,382 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-19 18:12:13,382 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:13,384 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:13,384 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:13,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:13,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:13,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:13,384 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:13,385 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-19 18:12:13,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:13,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:13,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:13,385 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-19 18:12:13,385 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-19 18:12:13,385 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:12:13,385 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-19 18:12:13,385 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,40317,1689790219525' in zk 2023-07-19 18:12:13,386 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:12:13,386 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 18:12:13,387 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-19 18:12:13,387 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 18:12:13,387 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-19 18:12:13,393 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 18:12:13,396 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 18:12:13,396 DEBUG [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689790332634.5059f0ddd6154c1c238e4f4b756556c1. 2023-07-19 18:12:13,396 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689790332634.25c95e9f1d57c1e8753bb4a2daf0eb9d. 2023-07-19 18:12:13,397 DEBUG [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689790332634.5059f0ddd6154c1c238e4f4b756556c1. started... 2023-07-19 18:12:13,396 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 18:12:13,397 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689790332634.25c95e9f1d57c1e8753bb4a2daf0eb9d. started... 2023-07-19 18:12:13,397 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 18:12:13,399 DEBUG [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5059f0ddd6154c1c238e4f4b756556c1: 2023-07-19 18:12:13,400 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 25c95e9f1d57c1e8753bb4a2daf0eb9d: 2023-07-19 18:12:13,400 DEBUG [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689790332634.5059f0ddd6154c1c238e4f4b756556c1.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:13,400 DEBUG [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 18:12:13,400 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689790332634.25c95e9f1d57c1e8753bb4a2daf0eb9d.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:13,400 DEBUG [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 18:12:13,400 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 18:12:13,401 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 18:12:13,426 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 18:12:13,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-19 18:12:13,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-19 18:12:13,428 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 18:12:13,438 DEBUG [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689790332634.5059f0ddd6154c1c238e4f4b756556c1. completed. 2023-07-19 18:12:13,439 DEBUG [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689790332634.5059f0ddd6154c1c238e4f4b756556c1. 2023-07-19 18:12:13,439 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 18:12:13,439 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 18:12:13,439 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:12:13,439 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-19 18:12:13,439 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,44407,1689790219668' in zk 2023-07-19 18:12:13,441 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:12:13,441 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-19 18:12:13,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:12:13,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 18:12:13,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 18:12:13,441 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 18:12:13,441 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-19 18:12:13,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 18:12:13,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 18:12:13,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:13,449 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689790332634.25c95e9f1d57c1e8753bb4a2daf0eb9d. completed. 2023-07-19 18:12:13,450 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689790332634.25c95e9f1d57c1e8753bb4a2daf0eb9d. 2023-07-19 18:12:13,450 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 18:12:13,450 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 18:12:13,450 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:12:13,450 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-19 18:12:13,450 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,33037,1689790219604' in zk 2023-07-19 18:12:13,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:12:13,458 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:12:13,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:12:13,458 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-19 18:12:13,458 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 18:12:13,458 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-19 18:12:13,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:12:13,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 18:12:13,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:13,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:12:13,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:12:13,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:12:13,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,44407,1689790219668': 2023-07-19 18:12:13,468 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44407,1689790219668' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-19 18:12:13,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:12:13,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 18:12:13,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 18:12:13,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 18:12:13,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 18:12:13,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:13,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:12:13,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:12:13,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:12:13,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 18:12:13,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:13,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:12:13,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:12:13,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:12:13,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,33037,1689790219604': 2023-07-19 18:12:13,477 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33037,1689790219604' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-19 18:12:13,477 INFO [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-19 18:12:13,477 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 18:12:13,477 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 18:12:13,477 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:13,477 INFO [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 18:12:13,489 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:13,489 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:13,489 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:13,489 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:12:13,489 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:13,489 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:12:13,489 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:12:13,489 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:13,489 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:13,489 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:13,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:13,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:13,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:13,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:13,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 18:12:13,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 18:12:13,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:12:13,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:12:13,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:12:13,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:12:13,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 18:12:13,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:13,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:12:13,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:12:13,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:13,491 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:12:13,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:13,492 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:12:13,492 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:12:13,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:13,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 18:12:13,500 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:12:13,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:13,501 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:12:13,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:12:13,501 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:12:13,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:12:13,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:12:13,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 18:12:13,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:13,506 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:12:13,506 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:12:13,506 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:12:13,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:12:13,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:12:13,506 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:12:13,506 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:12:13,506 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:12:13,506 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 18:12:13,507 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:13,506 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:13,507 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:12:13,515 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:12:13,515 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:13,515 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:12:13,515 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:13,515 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:12:13,515 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:12:13,515 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:13,515 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:13,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:12:13,509 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:12:13,507 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:13,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:12:13,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:12:13,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:12:13,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:12:13,515 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp because node does not exist (not an error) 2023-07-19 18:12:13,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:12:13,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:12:13,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:12:13,516 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:13,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:12:13,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:12:13,628 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 18:12:13,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-19 18:12:13,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-19 18:12:13,630 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 18:12:13,664 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:13,792 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-19 18:12:13,792 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:13,793 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:13,793 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689790333321Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689790333507 (+186 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689790333516 (+9 ms)Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689790333529 (+13 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689790333644 (+115 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689790333792 (+148 ms) 2023-07-19 18:12:13,796 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-19 18:12:13,798 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 473 msec 2023-07-19 18:12:13,930 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 18:12:13,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-19 18:12:13,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 18:12:13,939 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33037] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689790332634.25c95e9f1d57c1e8753bb4a2daf0eb9d. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 18:12:13,939 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44407] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689790332634.5059f0ddd6154c1c238e4f4b756556c1. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 18:12:13,944 DEBUG [Listener at jenkins-hbase4.apache.org/42301] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:13,944 DEBUG [Listener at jenkins-hbase4.apache.org/42301] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689790332634.25c95e9f1d57c1e8753bb4a2daf0eb9d. 2023-07-19 18:12:13,944 INFO [Listener at jenkins-hbase4.apache.org/42301] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 18:12:13,957 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-19 18:12:13,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689790333957 (current time:1689790333957). 2023-07-19 18:12:13,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 18:12:13,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] zookeeper.ReadOnlyZKClient(139): Connect 0x1e975cb4 to 127.0.0.1:51604 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 18:12:13,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@378f4b9e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 18:12:13,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 18:12:13,973 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45706, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 18:12:13,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1e975cb4 to 127.0.0.1:51604 2023-07-19 18:12:13,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 18:12:13,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] zookeeper.ReadOnlyZKClient(139): Connect 0x69b7ffc3 to 127.0.0.1:51604 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 18:12:13,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4de16cbd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 18:12:13,987 DEBUG [hconnection-0xff1d24-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 18:12:13,988 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45720, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 18:12:13,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x69b7ffc3 to 127.0.0.1:51604 2023-07-19 18:12:13,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 18:12:13,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-19 18:12:13,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 18:12:13,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-19 18:12:13,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-19 18:12:13,999 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-19 18:12:14,002 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689790934002 2023-07-19 18:12:14,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-19 18:12:14,002 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:14,004 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 18:12:14,004 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-19 18:12:14,004 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 18:12:14,004 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-19 18:12:14,007 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 7 msec 2023-07-19 18:12:14,008 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-19 18:12:14,009 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689790934009 2023-07-19 18:12:14,034 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:14,035 INFO [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-19 18:12:14,035 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 18:12:14,036 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-19 18:12:14,036 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-19 18:12:14,100 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:14,100 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:14,102 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:12:14,102 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:12:14,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:12:14,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:12:14,102 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:12:14,102 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:12:14,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:12:14,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:12:14,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:12:14,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:12:14,103 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:12:14,103 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:12:14,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:14,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:14,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:14,104 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:12:14,104 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 18:12:14,104 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:14,104 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:14,104 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:14,104 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 18:12:14,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-19 18:12:14,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:14,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-19 18:12:14,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:14,105 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-19 18:12:14,105 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-19 18:12:14,105 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:14,105 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-19 18:12:14,105 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 18:12:14,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-19 18:12:14,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:14,106 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-19 18:12:14,106 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:14,120 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-19 18:12:14,120 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-19 18:12:14,120 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-19 18:12:14,106 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:14,120 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44407,1689790219668' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-19 18:12:14,120 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-19 18:12:14,120 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 18:12:14,120 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 18:12:14,122 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-19 18:12:14,122 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-19 18:12:14,122 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33037,1689790219604' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-19 18:12:14,122 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-19 18:12:14,123 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-19 18:12:14,123 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40317,1689790219525' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-19 18:12:14,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-19 18:12:14,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-19 18:12:14,123 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 18:12:14,124 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:12:14,124 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:14,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:12:14,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 18:12:14,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 18:12:14,125 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:14,125 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:12:14,125 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:14,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 18:12:14,125 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:14,125 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 18:12:14,125 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:14,126 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 18:12:14,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 18:12:14,126 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:14,126 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 18:12:14,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:14,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:12:14,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:12:14,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:12:14,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 18:12:14,129 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44407,1689790219668' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-19 18:12:14,129 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@40a025ac[Count = 1] remaining members to acquire global barrier 2023-07-19 18:12:14,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:12:14,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 18:12:14,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 18:12:14,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 18:12:14,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 18:12:14,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:14,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:12:14,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:12:14,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:12:14,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 18:12:14,133 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33037,1689790219604' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-19 18:12:14,133 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@40a025ac[Count = 0] remaining members to acquire global barrier 2023-07-19 18:12:14,133 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-19 18:12:14,133 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:14,140 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:14,140 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:14,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:14,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:14,140 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:14,140 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-19 18:12:14,140 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:12:14,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:14,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:14,140 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 18:12:14,140 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 18:12:14,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:14,140 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689790332634.25c95e9f1d57c1e8753bb4a2daf0eb9d. 2023-07-19 18:12:14,141 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:12:14,141 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689790332634.25c95e9f1d57c1e8753bb4a2daf0eb9d. started... 2023-07-19 18:12:14,140 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-19 18:12:14,141 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 18:12:14,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:14,141 INFO [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 25c95e9f1d57c1e8753bb4a2daf0eb9d 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-07-19 18:12:14,141 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-19 18:12:14,141 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-19 18:12:14,141 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,40317,1689790219525' in zk 2023-07-19 18:12:14,142 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 18:12:14,142 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 18:12:14,143 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-19 18:12:14,143 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 18:12:14,143 DEBUG [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689790332634.5059f0ddd6154c1c238e4f4b756556c1. 2023-07-19 18:12:14,143 DEBUG [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689790332634.5059f0ddd6154c1c238e4f4b756556c1. started... 2023-07-19 18:12:14,143 DEBUG [member: 'jenkins-hbase4.apache.org,40317,1689790219525' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-19 18:12:14,144 INFO [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 5059f0ddd6154c1c238e4f4b756556c1 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-07-19 18:12:14,183 INFO [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=400 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithSkipTmp/25c95e9f1d57c1e8753bb4a2daf0eb9d/.tmp/cf/2228a1c92a8c43e883236995e3c9d832 2023-07-19 18:12:14,189 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithSkipTmp/25c95e9f1d57c1e8753bb4a2daf0eb9d/.tmp/cf/2228a1c92a8c43e883236995e3c9d832 as hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithSkipTmp/25c95e9f1d57c1e8753bb4a2daf0eb9d/cf/2228a1c92a8c43e883236995e3c9d832 2023-07-19 18:12:14,194 INFO [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithSkipTmp/25c95e9f1d57c1e8753bb4a2daf0eb9d/cf/2228a1c92a8c43e883236995e3c9d832, entries=6, sequenceid=6, filesize=5.2 K 2023-07-19 18:12:14,195 INFO [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for 25c95e9f1d57c1e8753bb4a2daf0eb9d in 54ms, sequenceid=6, compaction requested=false 2023-07-19 18:12:14,195 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-19 18:12:14,195 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 25c95e9f1d57c1e8753bb4a2daf0eb9d: 2023-07-19 18:12:14,196 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689790332634.25c95e9f1d57c1e8753bb4a2daf0eb9d.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:14,196 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 18:12:14,196 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithSkipTmp/25c95e9f1d57c1e8753bb4a2daf0eb9d/cf/2228a1c92a8c43e883236995e3c9d832] hfiles 2023-07-19 18:12:14,196 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithSkipTmp/25c95e9f1d57c1e8753bb4a2daf0eb9d/cf/2228a1c92a8c43e883236995e3c9d832 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:14,207 INFO [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.87 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithSkipTmp/5059f0ddd6154c1c238e4f4b756556c1/.tmp/cf/3503e997c575408db6cff4f46c5e1333 2023-07-19 18:12:14,210 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689790332634.25c95e9f1d57c1e8753bb4a2daf0eb9d. completed. 2023-07-19 18:12:14,211 DEBUG [rs(jenkins-hbase4.apache.org,33037,1689790219604)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689790332634.25c95e9f1d57c1e8753bb4a2daf0eb9d. 2023-07-19 18:12:14,211 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 18:12:14,211 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 18:12:14,211 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:12:14,211 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-19 18:12:14,211 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,33037,1689790219604' in zk 2023-07-19 18:12:14,212 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:12:14,212 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-19 18:12:14,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:12:14,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 18:12:14,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 18:12:14,212 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 18:12:14,213 DEBUG [member: 'jenkins-hbase4.apache.org,33037,1689790219604' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-19 18:12:14,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 18:12:14,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 18:12:14,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:14,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:12:14,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:12:14,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:12:14,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 18:12:14,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:14,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:12:14,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:12:14,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,33037,1689790219604': 2023-07-19 18:12:14,218 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33037,1689790219604' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-19 18:12:14,219 DEBUG [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithSkipTmp/5059f0ddd6154c1c238e4f4b756556c1/.tmp/cf/3503e997c575408db6cff4f46c5e1333 as hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithSkipTmp/5059f0ddd6154c1c238e4f4b756556c1/cf/3503e997c575408db6cff4f46c5e1333 2023-07-19 18:12:14,224 INFO [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithSkipTmp/5059f0ddd6154c1c238e4f4b756556c1/cf/3503e997c575408db6cff4f46c5e1333, entries=44, sequenceid=6, filesize=7.8 K 2023-07-19 18:12:14,224 INFO [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for 5059f0ddd6154c1c238e4f4b756556c1 in 80ms, sequenceid=6, compaction requested=false 2023-07-19 18:12:14,226 DEBUG [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5059f0ddd6154c1c238e4f4b756556c1: 2023-07-19 18:12:14,227 DEBUG [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689790332634.5059f0ddd6154c1c238e4f4b756556c1.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:14,227 DEBUG [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 18:12:14,227 DEBUG [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithSkipTmp/5059f0ddd6154c1c238e4f4b756556c1/cf/3503e997c575408db6cff4f46c5e1333] hfiles 2023-07-19 18:12:14,227 DEBUG [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithSkipTmp/5059f0ddd6154c1c238e4f4b756556c1/cf/3503e997c575408db6cff4f46c5e1333 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:14,236 DEBUG [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689790332634.5059f0ddd6154c1c238e4f4b756556c1. completed. 2023-07-19 18:12:14,236 DEBUG [rs(jenkins-hbase4.apache.org,44407,1689790219668)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689790332634.5059f0ddd6154c1c238e4f4b756556c1. 2023-07-19 18:12:14,237 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 18:12:14,237 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 18:12:14,237 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:12:14,237 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-19 18:12:14,237 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,44407,1689790219668' in zk 2023-07-19 18:12:14,239 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-19 18:12:14,239 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:12:14,239 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 18:12:14,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:12:14,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 18:12:14,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 18:12:14,240 DEBUG [member: 'jenkins-hbase4.apache.org,44407,1689790219668' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-19 18:12:14,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 18:12:14,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 18:12:14,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:14,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:12:14,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:12:14,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:12:14,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 18:12:14,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:14,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:12:14,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:12:14,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:12:14,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,44407,1689790219668': 2023-07-19 18:12:14,247 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44407,1689790219668' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-19 18:12:14,247 INFO [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-19 18:12:14,247 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 18:12:14,247 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 18:12:14,247 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:14,247 INFO [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 18:12:14,249 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:14,249 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:14,249 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:12:14,249 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:14,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:14,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:14,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:14,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:14,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:14,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 18:12:14,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 18:12:14,249 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:12:14,249 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:14,250 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:12:14,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:12:14,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:12:14,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:14,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 18:12:14,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:12:14,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:12:14,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:14,250 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:12:14,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:14,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:14,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:14,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:12:14,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:12:14,251 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:12:14,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 18:12:14,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:14,251 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:12:14,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:14,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:12:14,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:12:14,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:12:14,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 18:12:14,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:14,253 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:12:14,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:12:14,254 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:12:14,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:12:14,254 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:12:14,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:12:14,257 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:12:14,257 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:12:14,257 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:12:14,257 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:12:14,257 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 18:12:14,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:12:14,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:12:14,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:12:14,257 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:14,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:12:14,257 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:12:14,257 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 18:12:14,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 18:12:14,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 18:12:14,257 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:12:14,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:12:14,258 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:12:14,258 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:14,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:12:14,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:12:14,258 DEBUG [(jenkins-hbase4.apache.org,40453,1689790217932)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 18:12:14,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:12:14,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 18:12:14,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 18:12:14,258 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:14,258 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:12:14,258 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:14,258 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:14,258 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:12:14,258 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:12:14,258 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:14,258 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:14,259 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:14,299 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:14,316 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-19 18:12:14,316 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:14,316 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:14,316 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689790334002Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689790334258 (+256 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689790334258Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689790334276 (+18 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689790334291 (+15 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689790334316 (+25 ms) 2023-07-19 18:12:14,319 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-19 18:12:14,320 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 315 msec 2023-07-19 18:12:14,323 DEBUG [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 18:12:14,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-19 18:12:14,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 18:12:14,325 INFO [Listener at jenkins-hbase4.apache.org/42301] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/export-test/export-1689790334325 2023-07-19 18:12:14,325 INFO [Listener at jenkins-hbase4.apache.org/42301] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:40881, tgtDir=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/export-test/export-1689790334325, rawTgtDir=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/export-test/export-1689790334325, srcFsUri=hdfs://localhost:40881, srcDir=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf 2023-07-19 18:12:14,354 DEBUG [Listener at jenkins-hbase4.apache.org/42301] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:40881, inputRoot=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf 2023-07-19 18:12:14,354 DEBUG [Listener at jenkins-hbase4.apache.org/42301] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-959322298_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/export-test/export-1689790334325, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/export-test/export-1689790334325/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:14,354 INFO [Listener at jenkins-hbase4.apache.org/42301] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:40881, inputRoot=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf, snapshotDir=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-19 18:12:14,367 INFO [Listener at jenkins-hbase4.apache.org/42301] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/export-test/export-1689790334325/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:14,395 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 18:12:14,395 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 18:12:14,396 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 18:12:14,396 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 18:12:14,397 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-19 18:12:14,397 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 18:12:14,397 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 18:12:14,486 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/hadoop-2958302013523272958.jar 2023-07-19 18:12:14,486 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 18:12:14,487 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 18:12:14,487 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 18:12:14,488 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 18:12:14,488 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 18:12:14,489 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 18:12:14,489 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 18:12:14,490 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 18:12:14,491 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 18:12:14,491 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 18:12:14,492 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 18:12:14,492 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 18:12:14,492 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 18:12:14,493 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 18:12:14,493 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 18:12:14,494 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 18:12:14,495 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 18:12:14,495 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 18:12:14,496 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 18:12:14,496 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 18:12:14,496 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 18:12:14,497 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 18:12:14,498 DEBUG [Listener at jenkins-hbase4.apache.org/42301] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 18:12:15,130 WARN [Listener at jenkins-hbase4.apache.org/42301] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 18:12:15,133 INFO [Listener at jenkins-hbase4.apache.org/42301] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-19 18:12:15,136 DEBUG [Listener at jenkins-hbase4.apache.org/42301] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-19 18:12:16,555 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 18:12:16,555 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 18:12:16,563 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689790227140_0006_000001 (auth:SIMPLE) 2023-07-19 18:12:17,234 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689790227140_0007_000001 (auth:SIMPLE) 2023-07-19 18:12:17,716 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 18:12:22,350 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689790227140_0007_000001 (auth:SIMPLE) 2023-07-19 18:12:24,699 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689790227140_0007_000001 (auth:SIMPLE) 2023-07-19 18:12:29,940 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689790227140_0007_000001 (auth:SIMPLE) 2023-07-19 18:12:31,475 INFO [Listener at jenkins-hbase4.apache.org/42301] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 18:12:31,475 INFO [Listener at jenkins-hbase4.apache.org/42301] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 18:12:31,502 INFO [Listener at jenkins-hbase4.apache.org/42301] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:31,503 INFO [Listener at jenkins-hbase4.apache.org/42301] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 18:12:31,503 INFO [Listener at jenkins-hbase4.apache.org/42301] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 18:12:31,503 DEBUG [Listener at jenkins-hbase4.apache.org/42301] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2119224145_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:31,504 DEBUG [Listener at jenkins-hbase4.apache.org/42301] snapshot.TestExportSnapshot(367): hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-19 18:12:31,504 DEBUG [Listener at jenkins-hbase4.apache.org/42301] snapshot.TestExportSnapshot(367): hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-19 18:12:31,504 DEBUG [Listener at jenkins-hbase4.apache.org/42301] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2119224145_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/export-test/export-1689790334325/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/export-test/export-1689790334325/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:31,505 DEBUG [Listener at jenkins-hbase4.apache.org/42301] snapshot.TestExportSnapshot(367): hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/export-test/export-1689790334325/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-19 18:12:31,505 DEBUG [Listener at jenkins-hbase4.apache.org/42301] snapshot.TestExportSnapshot(367): hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/export-test/export-1689790334325/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-19 18:12:31,517 INFO [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:31,517 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:31,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:31,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-19 18:12:31,523 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689790351523"}]},"ts":"1689790351523"} 2023-07-19 18:12:31,525 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-19 18:12:31,527 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-19 18:12:31,530 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=25c95e9f1d57c1e8753bb4a2daf0eb9d, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=5059f0ddd6154c1c238e4f4b756556c1, UNASSIGN}] 2023-07-19 18:12:31,532 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=5059f0ddd6154c1c238e4f4b756556c1, UNASSIGN 2023-07-19 18:12:31,533 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=5059f0ddd6154c1c238e4f4b756556c1, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:12:31,535 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689790332634.5059f0ddd6154c1c238e4f4b756556c1.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689790351533"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689790351533"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689790351533"}]},"ts":"1689790351533"} 2023-07-19 18:12:31,535 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=25c95e9f1d57c1e8753bb4a2daf0eb9d, UNASSIGN 2023-07-19 18:12:31,538 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=25c95e9f1d57c1e8753bb4a2daf0eb9d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:12:31,538 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689790332634.25c95e9f1d57c1e8753bb4a2daf0eb9d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689790351538"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689790351538"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689790351538"}]},"ts":"1689790351538"} 2023-07-19 18:12:31,542 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure 25c95e9f1d57c1e8753bb4a2daf0eb9d, server=jenkins-hbase4.apache.org,33037,1689790219604}] 2023-07-19 18:12:31,543 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 5059f0ddd6154c1c238e4f4b756556c1, server=jenkins-hbase4.apache.org,44407,1689790219668}] 2023-07-19 18:12:31,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-19 18:12:31,695 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 25c95e9f1d57c1e8753bb4a2daf0eb9d 2023-07-19 18:12:31,695 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 25c95e9f1d57c1e8753bb4a2daf0eb9d, disabling compactions & flushes 2023-07-19 18:12:31,695 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689790332634.25c95e9f1d57c1e8753bb4a2daf0eb9d. 2023-07-19 18:12:31,695 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689790332634.25c95e9f1d57c1e8753bb4a2daf0eb9d. 2023-07-19 18:12:31,696 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689790332634.25c95e9f1d57c1e8753bb4a2daf0eb9d. after waiting 0 ms 2023-07-19 18:12:31,696 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689790332634.25c95e9f1d57c1e8753bb4a2daf0eb9d. 2023-07-19 18:12:31,697 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5059f0ddd6154c1c238e4f4b756556c1 2023-07-19 18:12:31,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5059f0ddd6154c1c238e4f4b756556c1, disabling compactions & flushes 2023-07-19 18:12:31,697 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689790332634.5059f0ddd6154c1c238e4f4b756556c1. 2023-07-19 18:12:31,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689790332634.5059f0ddd6154c1c238e4f4b756556c1. 2023-07-19 18:12:31,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689790332634.5059f0ddd6154c1c238e4f4b756556c1. after waiting 0 ms 2023-07-19 18:12:31,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689790332634.5059f0ddd6154c1c238e4f4b756556c1. 2023-07-19 18:12:31,741 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithSkipTmp/25c95e9f1d57c1e8753bb4a2daf0eb9d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 18:12:31,742 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 18:12:31,746 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689790332634.25c95e9f1d57c1e8753bb4a2daf0eb9d. 2023-07-19 18:12:31,747 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 25c95e9f1d57c1e8753bb4a2daf0eb9d: 2023-07-19 18:12:31,747 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/default/testtb-testExportFileSystemStateWithSkipTmp/5059f0ddd6154c1c238e4f4b756556c1/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 18:12:31,748 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 18:12:31,749 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 25c95e9f1d57c1e8753bb4a2daf0eb9d 2023-07-19 18:12:31,752 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689790332634.5059f0ddd6154c1c238e4f4b756556c1. 2023-07-19 18:12:31,752 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5059f0ddd6154c1c238e4f4b756556c1: 2023-07-19 18:12:31,752 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=25c95e9f1d57c1e8753bb4a2daf0eb9d, regionState=CLOSED 2023-07-19 18:12:31,753 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689790332634.25c95e9f1d57c1e8753bb4a2daf0eb9d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689790351752"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689790351752"}]},"ts":"1689790351752"} 2023-07-19 18:12:31,755 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5059f0ddd6154c1c238e4f4b756556c1 2023-07-19 18:12:31,755 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=5059f0ddd6154c1c238e4f4b756556c1, regionState=CLOSED 2023-07-19 18:12:31,755 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689790332634.5059f0ddd6154c1c238e4f4b756556c1.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689790351755"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689790351755"}]},"ts":"1689790351755"} 2023-07-19 18:12:31,757 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=115 2023-07-19 18:12:31,757 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure 25c95e9f1d57c1e8753bb4a2daf0eb9d, server=jenkins-hbase4.apache.org,33037,1689790219604 in 212 msec 2023-07-19 18:12:31,760 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=25c95e9f1d57c1e8753bb4a2daf0eb9d, UNASSIGN in 227 msec 2023-07-19 18:12:31,760 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-07-19 18:12:31,760 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 5059f0ddd6154c1c238e4f4b756556c1, server=jenkins-hbase4.apache.org,44407,1689790219668 in 214 msec 2023-07-19 18:12:31,762 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=116, resume processing ppid=114 2023-07-19 18:12:31,763 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=5059f0ddd6154c1c238e4f4b756556c1, UNASSIGN in 230 msec 2023-07-19 18:12:31,763 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689790351763"}]},"ts":"1689790351763"} 2023-07-19 18:12:31,765 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-19 18:12:31,770 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-19 18:12:31,772 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 254 msec 2023-07-19 18:12:31,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-19 18:12:31,826 INFO [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-19 18:12:31,828 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:31,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:31,832 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:31,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:31,834 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:31,835 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33037] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:31,838 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:31,838 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:31,839 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:31,839 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:31,839 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-19 18:12:31,841 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 18:12:31,841 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data null 2023-07-19 18:12:31,841 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:31,841 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 18:12:31,841 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-19 18:12:31,842 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 18:12:31,842 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data null 2023-07-19 18:12:31,842 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data null 2023-07-19 18:12:31,842 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-19 18:12:31,842 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 18:12:31,842 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-19 18:12:31,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-19 18:12:31,847 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/25c95e9f1d57c1e8753bb4a2daf0eb9d 2023-07-19 18:12:31,851 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5059f0ddd6154c1c238e4f4b756556c1 2023-07-19 18:12:31,853 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5059f0ddd6154c1c238e4f4b756556c1/cf, FileablePath, hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5059f0ddd6154c1c238e4f4b756556c1/recovered.edits] 2023-07-19 18:12:31,853 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/25c95e9f1d57c1e8753bb4a2daf0eb9d/cf, FileablePath, hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/25c95e9f1d57c1e8753bb4a2daf0eb9d/recovered.edits] 2023-07-19 18:12:31,875 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5059f0ddd6154c1c238e4f4b756556c1/cf/3503e997c575408db6cff4f46c5e1333 to hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/5059f0ddd6154c1c238e4f4b756556c1/cf/3503e997c575408db6cff4f46c5e1333 2023-07-19 18:12:31,875 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/25c95e9f1d57c1e8753bb4a2daf0eb9d/cf/2228a1c92a8c43e883236995e3c9d832 to hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/25c95e9f1d57c1e8753bb4a2daf0eb9d/cf/2228a1c92a8c43e883236995e3c9d832 2023-07-19 18:12:31,880 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5059f0ddd6154c1c238e4f4b756556c1/recovered.edits/9.seqid to hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/5059f0ddd6154c1c238e4f4b756556c1/recovered.edits/9.seqid 2023-07-19 18:12:31,881 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5059f0ddd6154c1c238e4f4b756556c1 2023-07-19 18:12:31,883 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/25c95e9f1d57c1e8753bb4a2daf0eb9d/recovered.edits/9.seqid to hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/25c95e9f1d57c1e8753bb4a2daf0eb9d/recovered.edits/9.seqid 2023-07-19 18:12:31,886 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/25c95e9f1d57c1e8753bb4a2daf0eb9d 2023-07-19 18:12:31,887 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-19 18:12:31,889 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:31,893 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-19 18:12:31,897 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-19 18:12:31,900 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:31,900 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-19 18:12:31,900 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689790332634.25c95e9f1d57c1e8753bb4a2daf0eb9d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689790351900"}]},"ts":"9223372036854775807"} 2023-07-19 18:12:31,900 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689790332634.5059f0ddd6154c1c238e4f4b756556c1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689790351900"}]},"ts":"9223372036854775807"} 2023-07-19 18:12:31,910 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-19 18:12:31,910 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 25c95e9f1d57c1e8753bb4a2daf0eb9d, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689790332634.25c95e9f1d57c1e8753bb4a2daf0eb9d.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 5059f0ddd6154c1c238e4f4b756556c1, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689790332634.5059f0ddd6154c1c238e4f4b756556c1.', STARTKEY => '1', ENDKEY => ''}] 2023-07-19 18:12:31,910 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-19 18:12:31,911 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689790351910"}]},"ts":"9223372036854775807"} 2023-07-19 18:12:31,913 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-19 18:12:31,916 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:31,918 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 88 msec 2023-07-19 18:12:31,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-19 18:12:31,944 INFO [Listener at jenkins-hbase4.apache.org/42301] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-19 18:12:31,956 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-19 18:12:31,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:31,960 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-19 18:12:31,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40453] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 18:12:32,013 INFO [Listener at jenkins-hbase4.apache.org/42301] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=769 (was 766) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2119224145_17 at /127.0.0.1:53896 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3af1d18e-shared-pool-44 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1477432893) connection to jenkins-hbase4.apache.org/172.31.14.131:44061 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x3af1d18e-shared-pool-45 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2119224145_17 at /127.0.0.1:38926 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3af1d18e-shared-pool-43 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2119224145_17 at /127.0.0.1:39134 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5325 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3af1d18e-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1872709880_1 at /127.0.0.1:46198 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=906 (was 905) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=713 (was 743), ProcessCount=188 (was 185) - ProcessCount LEAK? -, AvailableMemoryMB=1576 (was 1897) 2023-07-19 18:12:32,014 WARN [Listener at jenkins-hbase4.apache.org/42301] hbase.ResourceChecker(130): Thread=769 is superior to 500 2023-07-19 18:12:32,014 INFO [Listener at jenkins-hbase4.apache.org/42301] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-19 18:12:32,048 INFO [Listener at jenkins-hbase4.apache.org/42301] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-19 18:12:32,048 WARN [1632095320@qtp-812943225-1 - Acceptor0 HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:35453] http.HttpServer2$SelectChannelConnectorWithSafeStartup(546): HttpServer Acceptor: isRunning is false. Rechecking. 2023-07-19 18:12:32,048 WARN [1632095320@qtp-812943225-1 - Acceptor0 HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:35453] http.HttpServer2$SelectChannelConnectorWithSafeStartup(555): HttpServer Acceptor: isRunning is false 2023-07-19 18:12:36,062 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689790227140_0007_000001 (auth:SIMPLE) 2023-07-19 18:12:37,333 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 18:12:46,177 INFO [Listener at jenkins-hbase4.apache.org/42301] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-19 18:13:00,297 ERROR [Thread[Thread-409,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-19 18:13:00,298 INFO [Listener at jenkins-hbase4.apache.org/42301] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-19 18:13:00,410 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-19 18:13:00,430 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-19 18:13:00,432 ERROR [Thread[Thread-419,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-19 18:13:00,463 INFO [Listener at jenkins-hbase4.apache.org/42301] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-19 18:13:00,571 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-19 18:13:00,571 INFO [Listener at jenkins-hbase4.apache.org/42301] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-19 18:13:00,571 INFO [Listener at jenkins-hbase4.apache.org/42301] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-19 18:13:00,571 INFO [Listener at jenkins-hbase4.apache.org/42301] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-19 18:13:00,571 DEBUG [Listener at jenkins-hbase4.apache.org/42301] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1370d70b to 127.0.0.1:51604 2023-07-19 18:13:00,571 DEBUG [Listener at jenkins-hbase4.apache.org/42301] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 18:13:00,572 DEBUG [Listener at jenkins-hbase4.apache.org/42301] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-19 18:13:00,572 DEBUG [Listener at jenkins-hbase4.apache.org/42301] util.JVMClusterUtil(257): Found active master hash=1655812806, stopped=false 2023-07-19 18:13:00,572 DEBUG [Listener at jenkins-hbase4.apache.org/42301] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 18:13:00,572 DEBUG [Listener at jenkins-hbase4.apache.org/42301] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-19 18:13:00,572 INFO [Listener at jenkins-hbase4.apache.org/42301] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,40453,1689790217932 2023-07-19 18:13:00,574 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-19 18:13:00,574 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-19 18:13:00,574 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-19 18:13:00,574 INFO [Listener at jenkins-hbase4.apache.org/42301] procedure2.ProcedureExecutor(629): Stopping 2023-07-19 18:13:00,574 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-19 18:13:00,574 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 18:13:00,574 DEBUG [Listener at jenkins-hbase4.apache.org/42301] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1ac5cc0b to 127.0.0.1:51604 2023-07-19 18:13:00,574 DEBUG [Listener at jenkins-hbase4.apache.org/42301] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 18:13:00,574 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 18:13:00,574 INFO [Listener at jenkins-hbase4.apache.org/42301] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,40317,1689790219525' ***** 2023-07-19 18:13:00,575 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 18:13:00,575 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 18:13:00,575 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 18:13:00,575 DEBUG [Listener at jenkins-hbase4.apache.org/42301] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 18:13:00,575 INFO [Listener at jenkins-hbase4.apache.org/42301] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-19 18:13:00,575 INFO [Listener at jenkins-hbase4.apache.org/42301] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,33037,1689790219604' ***** 2023-07-19 18:13:00,575 DEBUG [Listener at jenkins-hbase4.apache.org/42301] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 18:13:00,575 INFO [Listener at jenkins-hbase4.apache.org/42301] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-19 18:13:00,576 INFO [Listener at jenkins-hbase4.apache.org/42301] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,44407,1689790219668' ***** 2023-07-19 18:13:00,576 DEBUG [Listener at jenkins-hbase4.apache.org/42301] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 18:13:00,576 INFO [Listener at jenkins-hbase4.apache.org/42301] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-19 18:13:00,576 INFO [RS:1;jenkins-hbase4:33037] regionserver.HeapMemoryManager(220): Stopping 2023-07-19 18:13:00,576 INFO [RS:2;jenkins-hbase4:44407] regionserver.HeapMemoryManager(220): Stopping 2023-07-19 18:13:00,576 INFO [RS:0;jenkins-hbase4:40317] regionserver.HeapMemoryManager(220): Stopping 2023-07-19 18:13:00,576 INFO [RS:1;jenkins-hbase4:33037] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-19 18:13:00,576 INFO [RS:0;jenkins-hbase4:40317] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-19 18:13:00,576 INFO [RS:1;jenkins-hbase4:33037] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-19 18:13:00,576 INFO [RS:0;jenkins-hbase4:40317] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-19 18:13:00,577 INFO [RS:0;jenkins-hbase4:40317] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:13:00,577 DEBUG [RS:0;jenkins-hbase4:40317] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4f36be74 to 127.0.0.1:51604 2023-07-19 18:13:00,577 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-19 18:13:00,576 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-19 18:13:00,576 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-19 18:13:00,576 INFO [RS:2;jenkins-hbase4:44407] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-19 18:13:00,577 INFO [RS:2;jenkins-hbase4:44407] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-19 18:13:00,577 INFO [RS:2;jenkins-hbase4:44407] regionserver.HRegionServer(3305): Received CLOSE for b30374cc412dfbdda00c47dbbf7094d8 2023-07-19 18:13:00,578 INFO [RS:2;jenkins-hbase4:44407] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:13:00,578 DEBUG [RS:2;jenkins-hbase4:44407] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x43458041 to 127.0.0.1:51604 2023-07-19 18:13:00,578 DEBUG [RS:2;jenkins-hbase4:44407] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 18:13:00,577 DEBUG [RS:0;jenkins-hbase4:40317] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 18:13:00,577 INFO [RS:1;jenkins-hbase4:33037] regionserver.HRegionServer(3305): Received CLOSE for 6d71765aa8180394c9cda6e0d8592f3e 2023-07-19 18:13:00,583 INFO [RS:0;jenkins-hbase4:40317] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,40317,1689790219525; all regions closed. 2023-07-19 18:13:00,583 INFO [RS:1;jenkins-hbase4:33037] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:13:00,580 INFO [RS:2;jenkins-hbase4:44407] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-19 18:13:00,579 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b30374cc412dfbdda00c47dbbf7094d8, disabling compactions & flushes 2023-07-19 18:13:00,583 DEBUG [RS:2;jenkins-hbase4:44407] regionserver.HRegionServer(1478): Online Regions={b30374cc412dfbdda00c47dbbf7094d8=hbase:namespace,,1689790222654.b30374cc412dfbdda00c47dbbf7094d8.} 2023-07-19 18:13:00,583 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6d71765aa8180394c9cda6e0d8592f3e, disabling compactions & flushes 2023-07-19 18:13:00,583 DEBUG [RS:1;jenkins-hbase4:33037] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2138077e to 127.0.0.1:51604 2023-07-19 18:13:00,584 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689790223471.6d71765aa8180394c9cda6e0d8592f3e. 2023-07-19 18:13:00,584 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689790222654.b30374cc412dfbdda00c47dbbf7094d8. 2023-07-19 18:13:00,584 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689790223471.6d71765aa8180394c9cda6e0d8592f3e. 2023-07-19 18:13:00,584 DEBUG [RS:1;jenkins-hbase4:33037] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 18:13:00,584 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689790223471.6d71765aa8180394c9cda6e0d8592f3e. after waiting 0 ms 2023-07-19 18:13:00,584 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689790222654.b30374cc412dfbdda00c47dbbf7094d8. 2023-07-19 18:13:00,585 INFO [RS:1;jenkins-hbase4:33037] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-19 18:13:00,585 INFO [RS:1;jenkins-hbase4:33037] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-19 18:13:00,585 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689790223471.6d71765aa8180394c9cda6e0d8592f3e. 2023-07-19 18:13:00,585 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 6d71765aa8180394c9cda6e0d8592f3e 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-19 18:13:00,585 INFO [RS:1;jenkins-hbase4:33037] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-19 18:13:00,585 DEBUG [RS:2;jenkins-hbase4:44407] regionserver.HRegionServer(1504): Waiting on b30374cc412dfbdda00c47dbbf7094d8 2023-07-19 18:13:00,585 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689790222654.b30374cc412dfbdda00c47dbbf7094d8. after waiting 0 ms 2023-07-19 18:13:00,585 INFO [RS:1;jenkins-hbase4:33037] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-19 18:13:00,585 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689790222654.b30374cc412dfbdda00c47dbbf7094d8. 2023-07-19 18:13:00,585 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing b30374cc412dfbdda00c47dbbf7094d8 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-19 18:13:00,586 INFO [RS:1;jenkins-hbase4:33037] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-19 18:13:00,587 DEBUG [RS:1;jenkins-hbase4:33037] regionserver.HRegionServer(1478): Online Regions={6d71765aa8180394c9cda6e0d8592f3e=hbase:acl,,1689790223471.6d71765aa8180394c9cda6e0d8592f3e., 1588230740=hbase:meta,,1.1588230740} 2023-07-19 18:13:00,587 DEBUG [RS:1;jenkins-hbase4:33037] regionserver.HRegionServer(1504): Waiting on 1588230740, 6d71765aa8180394c9cda6e0d8592f3e 2023-07-19 18:13:00,595 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-19 18:13:00,597 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-19 18:13:00,597 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-19 18:13:00,597 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-19 18:13:00,597 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-19 18:13:00,597 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-19 18:13:00,623 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-19 18:13:00,625 DEBUG [RS:0;jenkins-hbase4:40317] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/oldWALs 2023-07-19 18:13:00,625 INFO [RS:0;jenkins-hbase4:40317] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40317%2C1689790219525:(num 1689790222082) 2023-07-19 18:13:00,625 DEBUG [RS:0;jenkins-hbase4:40317] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 18:13:00,625 INFO [RS:0;jenkins-hbase4:40317] regionserver.LeaseManager(133): Closed leases 2023-07-19 18:13:00,625 INFO [RS:0;jenkins-hbase4:40317] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-19 18:13:00,625 INFO [RS:0;jenkins-hbase4:40317] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-19 18:13:00,625 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-19 18:13:00,625 INFO [RS:0;jenkins-hbase4:40317] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-19 18:13:00,626 INFO [RS:0;jenkins-hbase4:40317] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-19 18:13:00,627 INFO [RS:0;jenkins-hbase4:40317] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40317 2023-07-19 18:13:00,640 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-19 18:13:00,641 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:13:00,641 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 18:13:00,641 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:13:00,641 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 18:13:00,641 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 18:13:00,642 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40317,1689790219525 2023-07-19 18:13:00,642 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 18:13:00,643 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-19 18:13:00,649 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40317,1689790219525] 2023-07-19 18:13:00,653 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40317,1689790219525; numProcessing=1 2023-07-19 18:13:00,664 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40317,1689790219525 already deleted, retry=false 2023-07-19 18:13:00,665 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40317,1689790219525 expired; onlineServers=2 2023-07-19 18:13:00,665 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/hbase/meta/1588230740/.tmp/info/8098e20d8e9d40d9b8bf7dd441bf1052 2023-07-19 18:13:00,680 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/hbase/acl/6d71765aa8180394c9cda6e0d8592f3e/.tmp/l/ce296ba2e28b44afb2cc75b325db91a6 2023-07-19 18:13:00,681 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/hbase/namespace/b30374cc412dfbdda00c47dbbf7094d8/.tmp/info/6997ae98eb6b4dd88a83cd73234cca42 2023-07-19 18:13:00,693 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8098e20d8e9d40d9b8bf7dd441bf1052 2023-07-19 18:13:00,703 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/hbase/namespace/b30374cc412dfbdda00c47dbbf7094d8/.tmp/info/6997ae98eb6b4dd88a83cd73234cca42 as hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/hbase/namespace/b30374cc412dfbdda00c47dbbf7094d8/info/6997ae98eb6b4dd88a83cd73234cca42 2023-07-19 18:13:00,712 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ce296ba2e28b44afb2cc75b325db91a6 2023-07-19 18:13:00,713 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/hbase/acl/6d71765aa8180394c9cda6e0d8592f3e/.tmp/l/ce296ba2e28b44afb2cc75b325db91a6 as hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/hbase/acl/6d71765aa8180394c9cda6e0d8592f3e/l/ce296ba2e28b44afb2cc75b325db91a6 2023-07-19 18:13:00,731 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ce296ba2e28b44afb2cc75b325db91a6 2023-07-19 18:13:00,731 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/hbase/acl/6d71765aa8180394c9cda6e0d8592f3e/l/ce296ba2e28b44afb2cc75b325db91a6, entries=7, sequenceid=18, filesize=5.2 K 2023-07-19 18:13:00,732 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 6d71765aa8180394c9cda6e0d8592f3e in 147ms, sequenceid=18, compaction requested=false 2023-07-19 18:13:00,732 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/hbase/namespace/b30374cc412dfbdda00c47dbbf7094d8/info/6997ae98eb6b4dd88a83cd73234cca42, entries=2, sequenceid=6, filesize=4.8 K 2023-07-19 18:13:00,734 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for b30374cc412dfbdda00c47dbbf7094d8 in 149ms, sequenceid=6, compaction requested=false 2023-07-19 18:13:00,750 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 18:13:00,750 INFO [RS:0;jenkins-hbase4:40317] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,40317,1689790219525; zookeeper connection closed. 2023-07-19 18:13:00,750 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:40317-0x1017ec6fe090001, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 18:13:00,753 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5a8b2613] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5a8b2613 2023-07-19 18:13:00,762 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/hbase/meta/1588230740/.tmp/rep_barrier/4da4e1972ed149e8b634eadd77711e93 2023-07-19 18:13:00,767 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/hbase/acl/6d71765aa8180394c9cda6e0d8592f3e/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-19 18:13:00,768 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 18:13:00,768 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4da4e1972ed149e8b634eadd77711e93 2023-07-19 18:13:00,770 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689790223471.6d71765aa8180394c9cda6e0d8592f3e. 2023-07-19 18:13:00,771 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6d71765aa8180394c9cda6e0d8592f3e: 2023-07-19 18:13:00,771 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689790223471.6d71765aa8180394c9cda6e0d8592f3e. 2023-07-19 18:13:00,774 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/hbase/namespace/b30374cc412dfbdda00c47dbbf7094d8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 18:13:00,775 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 18:13:00,776 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689790222654.b30374cc412dfbdda00c47dbbf7094d8. 2023-07-19 18:13:00,776 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b30374cc412dfbdda00c47dbbf7094d8: 2023-07-19 18:13:00,776 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689790222654.b30374cc412dfbdda00c47dbbf7094d8. 2023-07-19 18:13:00,785 INFO [RS:2;jenkins-hbase4:44407] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,44407,1689790219668; all regions closed. 2023-07-19 18:13:00,787 DEBUG [RS:1;jenkins-hbase4:33037] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-19 18:13:00,810 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/WALs/jenkins-hbase4.apache.org,44407,1689790219668/jenkins-hbase4.apache.org%2C44407%2C1689790219668.1689790222081 not finished, retry = 0 2023-07-19 18:13:00,812 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/hbase/meta/1588230740/.tmp/table/ec3d2271820540d0884fd241bff7c164 2023-07-19 18:13:00,817 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ec3d2271820540d0884fd241bff7c164 2023-07-19 18:13:00,818 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/hbase/meta/1588230740/.tmp/info/8098e20d8e9d40d9b8bf7dd441bf1052 as hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/hbase/meta/1588230740/info/8098e20d8e9d40d9b8bf7dd441bf1052 2023-07-19 18:13:00,824 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8098e20d8e9d40d9b8bf7dd441bf1052 2023-07-19 18:13:00,824 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/hbase/meta/1588230740/info/8098e20d8e9d40d9b8bf7dd441bf1052, entries=48, sequenceid=131, filesize=10.3 K 2023-07-19 18:13:00,826 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/hbase/meta/1588230740/.tmp/rep_barrier/4da4e1972ed149e8b634eadd77711e93 as hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/hbase/meta/1588230740/rep_barrier/4da4e1972ed149e8b634eadd77711e93 2023-07-19 18:13:00,833 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4da4e1972ed149e8b634eadd77711e93 2023-07-19 18:13:00,833 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/hbase/meta/1588230740/rep_barrier/4da4e1972ed149e8b634eadd77711e93, entries=13, sequenceid=131, filesize=6.4 K 2023-07-19 18:13:00,834 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/hbase/meta/1588230740/.tmp/table/ec3d2271820540d0884fd241bff7c164 as hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/hbase/meta/1588230740/table/ec3d2271820540d0884fd241bff7c164 2023-07-19 18:13:00,840 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ec3d2271820540d0884fd241bff7c164 2023-07-19 18:13:00,840 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/hbase/meta/1588230740/table/ec3d2271820540d0884fd241bff7c164, entries=24, sequenceid=131, filesize=6.9 K 2023-07-19 18:13:00,841 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 244ms, sequenceid=131, compaction requested=false 2023-07-19 18:13:00,845 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-19 18:13:00,845 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-19 18:13:00,856 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-19 18:13:00,856 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-19 18:13:00,869 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-19 18:13:00,870 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 18:13:00,870 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-19 18:13:00,870 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-19 18:13:00,871 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-19 18:13:00,871 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-19 18:13:00,914 DEBUG [RS:2;jenkins-hbase4:44407] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/oldWALs 2023-07-19 18:13:00,914 INFO [RS:2;jenkins-hbase4:44407] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44407%2C1689790219668:(num 1689790222081) 2023-07-19 18:13:00,914 DEBUG [RS:2;jenkins-hbase4:44407] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 18:13:00,914 INFO [RS:2;jenkins-hbase4:44407] regionserver.LeaseManager(133): Closed leases 2023-07-19 18:13:00,914 INFO [RS:2;jenkins-hbase4:44407] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-19 18:13:00,915 INFO [RS:2;jenkins-hbase4:44407] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-19 18:13:00,915 INFO [RS:2;jenkins-hbase4:44407] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-19 18:13:00,915 INFO [RS:2;jenkins-hbase4:44407] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-19 18:13:00,915 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-19 18:13:00,918 INFO [RS:2;jenkins-hbase4:44407] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44407 2023-07-19 18:13:00,919 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:13:00,919 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44407,1689790219668 2023-07-19 18:13:00,919 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 18:13:00,922 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,44407,1689790219668] 2023-07-19 18:13:00,922 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,44407,1689790219668; numProcessing=2 2023-07-19 18:13:00,924 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,44407,1689790219668 already deleted, retry=false 2023-07-19 18:13:00,924 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,44407,1689790219668 expired; onlineServers=1 2023-07-19 18:13:00,987 INFO [RS:1;jenkins-hbase4:33037] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,33037,1689790219604; all regions closed. 2023-07-19 18:13:00,994 DEBUG [RS:1;jenkins-hbase4:33037] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/oldWALs 2023-07-19 18:13:00,995 INFO [RS:1;jenkins-hbase4:33037] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33037%2C1689790219604.meta:.meta(num 1689790222239) 2023-07-19 18:13:01,001 DEBUG [RS:1;jenkins-hbase4:33037] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/oldWALs 2023-07-19 18:13:01,002 INFO [RS:1;jenkins-hbase4:33037] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33037%2C1689790219604:(num 1689790222084) 2023-07-19 18:13:01,002 DEBUG [RS:1;jenkins-hbase4:33037] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 18:13:01,002 INFO [RS:1;jenkins-hbase4:33037] regionserver.LeaseManager(133): Closed leases 2023-07-19 18:13:01,002 INFO [RS:1;jenkins-hbase4:33037] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-19 18:13:01,003 INFO [RS:1;jenkins-hbase4:33037] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33037 2023-07-19 18:13:01,003 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-19 18:13:01,023 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 18:13:01,023 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:44407-0x1017ec6fe090003, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 18:13:01,023 INFO [RS:2;jenkins-hbase4:44407] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,44407,1689790219668; zookeeper connection closed. 2023-07-19 18:13:01,024 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4d8618b8] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4d8618b8 2023-07-19 18:13:01,025 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33037,1689790219604 2023-07-19 18:13:01,025 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 18:13:01,027 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,33037,1689790219604] 2023-07-19 18:13:01,027 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,33037,1689790219604; numProcessing=3 2023-07-19 18:13:01,028 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,33037,1689790219604 already deleted, retry=false 2023-07-19 18:13:01,028 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,33037,1689790219604 expired; onlineServers=0 2023-07-19 18:13:01,028 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,40453,1689790217932' ***** 2023-07-19 18:13:01,028 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-19 18:13:01,029 DEBUG [M:0;jenkins-hbase4:40453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@238cb8fd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-19 18:13:01,029 INFO [M:0;jenkins-hbase4:40453] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,40453,1689790217932 2023-07-19 18:13:01,029 INFO [M:0;jenkins-hbase4:40453] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,40453,1689790217932; all regions closed. 2023-07-19 18:13:01,029 DEBUG [M:0;jenkins-hbase4:40453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 18:13:01,029 DEBUG [M:0;jenkins-hbase4:40453] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-19 18:13:01,029 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-19 18:13:01,029 DEBUG [M:0;jenkins-hbase4:40453] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-19 18:13:01,029 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689790221466] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689790221466,5,FailOnTimeoutGroup] 2023-07-19 18:13:01,029 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689790221470] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689790221470,5,FailOnTimeoutGroup] 2023-07-19 18:13:01,029 INFO [M:0;jenkins-hbase4:40453] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-19 18:13:01,029 INFO [M:0;jenkins-hbase4:40453] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-19 18:13:01,030 INFO [M:0;jenkins-hbase4:40453] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-19 18:13:01,030 DEBUG [M:0;jenkins-hbase4:40453] master.HMaster(1512): Stopping service threads 2023-07-19 18:13:01,030 INFO [M:0;jenkins-hbase4:40453] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-19 18:13:01,030 ERROR [M:0;jenkins-hbase4:40453] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-19 18:13:01,031 INFO [M:0;jenkins-hbase4:40453] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-19 18:13:01,031 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-19 18:13:01,031 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-19 18:13:01,032 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 18:13:01,032 DEBUG [M:0;jenkins-hbase4:40453] zookeeper.ZKUtil(398): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-19 18:13:01,032 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-19 18:13:01,032 WARN [M:0;jenkins-hbase4:40453] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-19 18:13:01,032 INFO [M:0;jenkins-hbase4:40453] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-19 18:13:01,032 INFO [M:0;jenkins-hbase4:40453] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-19 18:13:01,033 DEBUG [M:0;jenkins-hbase4:40453] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-19 18:13:01,033 INFO [M:0;jenkins-hbase4:40453] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 18:13:01,033 DEBUG [M:0;jenkins-hbase4:40453] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 18:13:01,033 DEBUG [M:0;jenkins-hbase4:40453] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-19 18:13:01,033 DEBUG [M:0;jenkins-hbase4:40453] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 18:13:01,034 INFO [M:0;jenkins-hbase4:40453] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=373.35 KB heapSize=449.63 KB 2023-07-19 18:13:01,065 INFO [M:0;jenkins-hbase4:40453] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=373.35 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/842ac538767c4405ab238a026afa8e1c 2023-07-19 18:13:01,070 INFO [M:0;jenkins-hbase4:40453] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 842ac538767c4405ab238a026afa8e1c 2023-07-19 18:13:01,071 DEBUG [M:0;jenkins-hbase4:40453] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/842ac538767c4405ab238a026afa8e1c as hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/842ac538767c4405ab238a026afa8e1c 2023-07-19 18:13:01,076 INFO [M:0;jenkins-hbase4:40453] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 842ac538767c4405ab238a026afa8e1c 2023-07-19 18:13:01,076 INFO [M:0;jenkins-hbase4:40453] regionserver.HStore(1080): Added hdfs://localhost:40881/user/jenkins/test-data/3f1e3cd9-46a5-3c53-dd8e-035fbe776caf/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/842ac538767c4405ab238a026afa8e1c, entries=119, sequenceid=899, filesize=28.5 K 2023-07-19 18:13:01,077 INFO [M:0;jenkins-hbase4:40453] regionserver.HRegion(2948): Finished flush of dataSize ~373.35 KB/382313, heapSize ~449.61 KB/460400, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 43ms, sequenceid=899, compaction requested=false 2023-07-19 18:13:01,079 INFO [M:0;jenkins-hbase4:40453] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 18:13:01,079 DEBUG [M:0;jenkins-hbase4:40453] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-19 18:13:01,083 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-19 18:13:01,083 INFO [M:0;jenkins-hbase4:40453] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-19 18:13:01,083 INFO [M:0;jenkins-hbase4:40453] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40453 2023-07-19 18:13:01,086 DEBUG [M:0;jenkins-hbase4:40453] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,40453,1689790217932 already deleted, retry=false 2023-07-19 18:13:01,127 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 18:13:01,127 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): regionserver:33037-0x1017ec6fe090002, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 18:13:01,127 INFO [RS:1;jenkins-hbase4:33037] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,33037,1689790219604; zookeeper connection closed. 2023-07-19 18:13:01,127 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@398bb05d] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@398bb05d 2023-07-19 18:13:01,128 INFO [Listener at jenkins-hbase4.apache.org/42301] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-19 18:13:01,227 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 18:13:01,227 DEBUG [Listener at localhost/41305-EventThread] zookeeper.ZKWatcher(600): master:40453-0x1017ec6fe090000, quorum=127.0.0.1:51604, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 18:13:01,227 INFO [M:0;jenkins-hbase4:40453] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,40453,1689790217932; zookeeper connection closed. 2023-07-19 18:13:01,230 WARN [Listener at jenkins-hbase4.apache.org/42301] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-19 18:13:01,237 INFO [Listener at jenkins-hbase4.apache.org/42301] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-19 18:13:01,238 WARN [2139059340@qtp-36289380-1 - Acceptor0 HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33685] http.HttpServer2$SelectChannelConnectorWithSafeStartup(546): HttpServer Acceptor: isRunning is false. Rechecking. 2023-07-19 18:13:01,238 WARN [2139059340@qtp-36289380-1 - Acceptor0 HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33685] http.HttpServer2$SelectChannelConnectorWithSafeStartup(555): HttpServer Acceptor: isRunning is false 2023-07-19 18:13:01,341 WARN [BP-853202222-172.31.14.131-1689790213745 heartbeating to localhost/127.0.0.1:40881] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-19 18:13:01,341 WARN [BP-853202222-172.31.14.131-1689790213745 heartbeating to localhost/127.0.0.1:40881] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-853202222-172.31.14.131-1689790213745 (Datanode Uuid e53dee0c-96c9-432f-938c-bdcff9b15cdf) service to localhost/127.0.0.1:40881 2023-07-19 18:13:01,343 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/cluster_043905fa-2e83-af1f-d7d3-c2f0c5ac65c2/dfs/data/data5/current/BP-853202222-172.31.14.131-1689790213745] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 18:13:01,344 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/cluster_043905fa-2e83-af1f-d7d3-c2f0c5ac65c2/dfs/data/data6/current/BP-853202222-172.31.14.131-1689790213745] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 18:13:01,348 WARN [Listener at jenkins-hbase4.apache.org/42301] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-19 18:13:01,351 INFO [Listener at jenkins-hbase4.apache.org/42301] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-19 18:13:01,457 WARN [BP-853202222-172.31.14.131-1689790213745 heartbeating to localhost/127.0.0.1:40881] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-19 18:13:01,457 WARN [BP-853202222-172.31.14.131-1689790213745 heartbeating to localhost/127.0.0.1:40881] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-853202222-172.31.14.131-1689790213745 (Datanode Uuid 66a31133-ac7f-4072-9f43-6a048acb97a2) service to localhost/127.0.0.1:40881 2023-07-19 18:13:01,458 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/cluster_043905fa-2e83-af1f-d7d3-c2f0c5ac65c2/dfs/data/data3/current/BP-853202222-172.31.14.131-1689790213745] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 18:13:01,459 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/cluster_043905fa-2e83-af1f-d7d3-c2f0c5ac65c2/dfs/data/data4/current/BP-853202222-172.31.14.131-1689790213745] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 18:13:01,460 WARN [Listener at jenkins-hbase4.apache.org/42301] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-19 18:13:01,468 INFO [Listener at jenkins-hbase4.apache.org/42301] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-19 18:13:01,567 WARN [BP-853202222-172.31.14.131-1689790213745 heartbeating to localhost/127.0.0.1:40881] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-853202222-172.31.14.131-1689790213745 (Datanode Uuid 711cbe76-14c4-4bfc-84f2-1aa9e4e19de4) service to localhost/127.0.0.1:40881 2023-07-19 18:13:01,599 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/cluster_043905fa-2e83-af1f-d7d3-c2f0c5ac65c2/dfs/data/data1/current/BP-853202222-172.31.14.131-1689790213745] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 18:13:01,601 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f39695b7-4297-3532-4c47-2078be3c79c4/cluster_043905fa-2e83-af1f-d7d3-c2f0c5ac65c2/dfs/data/data2/current/BP-853202222-172.31.14.131-1689790213745] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 18:13:01,627 INFO [Listener at jenkins-hbase4.apache.org/42301] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-19 18:13:01,660 INFO [Listener at jenkins-hbase4.apache.org/42301] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-19 18:13:01,772 INFO [Listener at jenkins-hbase4.apache.org/42301] hbase.HBaseTestingUtility(1293): Minicluster is down