2023-07-15 21:10:44,720 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-15 21:10:44,970 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4 2023-07-15 21:10:44,970 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestSecureExportSnapshot timeout: 13 mins 2023-07-15 21:10:45,014 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-15 21:10:45,275 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-15 21:10:45,275 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/cluster_744bf9ce-7834-b46f-9b3b-2856eea562b1, deleteOnExit=true 2023-07-15 21:10:45,275 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-15 21:10:45,276 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/test.cache.data in system properties and HBase conf 2023-07-15 21:10:45,276 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/hadoop.tmp.dir in system properties and HBase conf 2023-07-15 21:10:45,277 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/hadoop.log.dir in system properties and HBase conf 2023-07-15 21:10:45,277 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-15 21:10:45,278 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-15 21:10:45,278 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-15 21:10:45,607 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-15 21:10:45,614 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-15 21:10:45,614 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-15 21:10:45,615 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-15 21:10:45,615 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-15 21:10:45,616 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-15 21:10:45,616 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-15 21:10:45,616 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-15 21:10:45,617 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-15 21:10:45,617 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-15 21:10:45,618 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/nfs.dump.dir in system properties and HBase conf 2023-07-15 21:10:45,618 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/java.io.tmpdir in system properties and HBase conf 2023-07-15 21:10:45,618 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-15 21:10:45,619 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-15 21:10:45,619 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-15 21:10:46,248 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-15 21:10:46,252 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-15 21:10:46,516 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-15 21:10:46,677 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-15 21:10:46,690 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 21:10:46,723 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 21:10:46,762 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/java.io.tmpdir/Jetty_localhost_43653_hdfs____.k6mn6p/webapp 2023-07-15 21:10:46,914 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43653 2023-07-15 21:10:46,948 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-15 21:10:46,949 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-15 21:10:47,400 WARN [Listener at localhost/45529] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-15 21:10:47,501 WARN [Listener at localhost/45529] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-15 21:10:47,559 WARN [Listener at localhost/45529] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 21:10:47,567 INFO [Listener at localhost/45529] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 21:10:47,580 INFO [Listener at localhost/45529] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/java.io.tmpdir/Jetty_localhost_35505_datanode____.m38pfl/webapp 2023-07-15 21:10:47,725 INFO [Listener at localhost/45529] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35505 2023-07-15 21:10:48,215 WARN [Listener at localhost/43841] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-15 21:10:48,304 WARN [Listener at localhost/43841] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-15 21:10:48,308 WARN [Listener at localhost/43841] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 21:10:48,311 INFO [Listener at localhost/43841] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 21:10:48,318 INFO [Listener at localhost/43841] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/java.io.tmpdir/Jetty_localhost_35953_datanode____.phqkys/webapp 2023-07-15 21:10:48,492 INFO [Listener at localhost/43841] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35953 2023-07-15 21:10:48,514 WARN [Listener at localhost/43315] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-15 21:10:48,555 WARN [Listener at localhost/43315] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-15 21:10:48,558 WARN [Listener at localhost/43315] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 21:10:48,560 INFO [Listener at localhost/43315] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 21:10:48,566 INFO [Listener at localhost/43315] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/java.io.tmpdir/Jetty_localhost_38001_datanode____.alxwtp/webapp 2023-07-15 21:10:48,713 INFO [Listener at localhost/43315] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38001 2023-07-15 21:10:48,778 WARN [Listener at localhost/33869] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-15 21:10:48,931 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2ac67067e0e445d4: Processing first storage report for DS-84fa3c94-a8f2-4f8b-807c-b6cef7a50dee from datanode 1b962843-5474-4efb-ab5a-166842a8ec9d 2023-07-15 21:10:48,933 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2ac67067e0e445d4: from storage DS-84fa3c94-a8f2-4f8b-807c-b6cef7a50dee node DatanodeRegistration(127.0.0.1:40619, datanodeUuid=1b962843-5474-4efb-ab5a-166842a8ec9d, infoPort=34353, infoSecurePort=0, ipcPort=43315, storageInfo=lv=-57;cid=testClusterID;nsid=252512710;c=1689455446321), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-15 21:10:48,933 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x85c1139504e8f808: Processing first storage report for DS-0010cdf8-832e-45a0-9524-30448d7cf0af from datanode bf7c710d-cc5a-4845-b944-adee1af6f560 2023-07-15 21:10:48,934 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x85c1139504e8f808: from storage DS-0010cdf8-832e-45a0-9524-30448d7cf0af node DatanodeRegistration(127.0.0.1:38767, datanodeUuid=bf7c710d-cc5a-4845-b944-adee1af6f560, infoPort=46141, infoSecurePort=0, ipcPort=43841, storageInfo=lv=-57;cid=testClusterID;nsid=252512710;c=1689455446321), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-15 21:10:48,934 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2ac67067e0e445d4: Processing first storage report for DS-3f260abd-96f8-4a60-ad4a-e2b59f471b7f from datanode 1b962843-5474-4efb-ab5a-166842a8ec9d 2023-07-15 21:10:48,934 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2ac67067e0e445d4: from storage DS-3f260abd-96f8-4a60-ad4a-e2b59f471b7f node DatanodeRegistration(127.0.0.1:40619, datanodeUuid=1b962843-5474-4efb-ab5a-166842a8ec9d, infoPort=34353, infoSecurePort=0, ipcPort=43315, storageInfo=lv=-57;cid=testClusterID;nsid=252512710;c=1689455446321), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-15 21:10:48,934 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x85c1139504e8f808: Processing first storage report for DS-67d70364-ead2-4683-8e4f-6f6ded79bb79 from datanode bf7c710d-cc5a-4845-b944-adee1af6f560 2023-07-15 21:10:48,934 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x85c1139504e8f808: from storage DS-67d70364-ead2-4683-8e4f-6f6ded79bb79 node DatanodeRegistration(127.0.0.1:38767, datanodeUuid=bf7c710d-cc5a-4845-b944-adee1af6f560, infoPort=46141, infoSecurePort=0, ipcPort=43841, storageInfo=lv=-57;cid=testClusterID;nsid=252512710;c=1689455446321), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-15 21:10:49,034 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf203f084a57ea76f: Processing first storage report for DS-ea74c57e-1dec-4aa7-a28c-083a664bfded from datanode eacbdee9-5025-449b-9661-bbde62b6d035 2023-07-15 21:10:49,034 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf203f084a57ea76f: from storage DS-ea74c57e-1dec-4aa7-a28c-083a664bfded node DatanodeRegistration(127.0.0.1:40561, datanodeUuid=eacbdee9-5025-449b-9661-bbde62b6d035, infoPort=36213, infoSecurePort=0, ipcPort=33869, storageInfo=lv=-57;cid=testClusterID;nsid=252512710;c=1689455446321), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-15 21:10:49,035 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf203f084a57ea76f: Processing first storage report for DS-751aa2ba-c144-4b65-92a6-ecc9058e009c from datanode eacbdee9-5025-449b-9661-bbde62b6d035 2023-07-15 21:10:49,035 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf203f084a57ea76f: from storage DS-751aa2ba-c144-4b65-92a6-ecc9058e009c node DatanodeRegistration(127.0.0.1:40561, datanodeUuid=eacbdee9-5025-449b-9661-bbde62b6d035, infoPort=36213, infoSecurePort=0, ipcPort=33869, storageInfo=lv=-57;cid=testClusterID;nsid=252512710;c=1689455446321), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-15 21:10:49,282 DEBUG [Listener at localhost/33869] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4 2023-07-15 21:10:49,381 INFO [Listener at localhost/33869] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/cluster_744bf9ce-7834-b46f-9b3b-2856eea562b1/zookeeper_0, clientPort=57175, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/cluster_744bf9ce-7834-b46f-9b3b-2856eea562b1/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/cluster_744bf9ce-7834-b46f-9b3b-2856eea562b1/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-15 21:10:49,399 INFO [Listener at localhost/33869] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=57175 2023-07-15 21:10:49,410 INFO [Listener at localhost/33869] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 21:10:49,412 INFO [Listener at localhost/33869] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 21:10:50,148 INFO [Listener at localhost/33869] util.FSUtils(471): Created version file at hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f with version=8 2023-07-15 21:10:50,148 INFO [Listener at localhost/33869] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/hbase-staging 2023-07-15 21:10:50,508 INFO [Listener at localhost/33869] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-15 21:10:51,079 INFO [Listener at localhost/33869] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-15 21:10:51,121 INFO [Listener at localhost/33869] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 21:10:51,122 INFO [Listener at localhost/33869] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-15 21:10:51,122 INFO [Listener at localhost/33869] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-15 21:10:51,122 INFO [Listener at localhost/33869] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 21:10:51,122 INFO [Listener at localhost/33869] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-15 21:10:51,329 INFO [Listener at localhost/33869] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-15 21:10:51,406 DEBUG [Listener at localhost/33869] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-15 21:10:51,531 INFO [Listener at localhost/33869] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44929 2023-07-15 21:10:51,549 INFO [Listener at localhost/33869] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 21:10:51,551 INFO [Listener at localhost/33869] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 21:10:51,578 INFO [Listener at localhost/33869] zookeeper.RecoverableZooKeeper(93): Process identifier=master:44929 connecting to ZooKeeper ensemble=127.0.0.1:57175 2023-07-15 21:10:51,628 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:449290x0, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-15 21:10:51,631 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:44929-0x1016ad2d8110000 connected 2023-07-15 21:10:51,663 DEBUG [Listener at localhost/33869] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-15 21:10:51,665 DEBUG [Listener at localhost/33869] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 21:10:51,679 DEBUG [Listener at localhost/33869] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-15 21:10:51,693 DEBUG [Listener at localhost/33869] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44929 2023-07-15 21:10:51,693 DEBUG [Listener at localhost/33869] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44929 2023-07-15 21:10:51,694 DEBUG [Listener at localhost/33869] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44929 2023-07-15 21:10:51,694 DEBUG [Listener at localhost/33869] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44929 2023-07-15 21:10:51,695 DEBUG [Listener at localhost/33869] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44929 2023-07-15 21:10:51,703 INFO [Listener at localhost/33869] master.HMaster(444): hbase.rootdir=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f, hbase.cluster.distributed=false 2023-07-15 21:10:51,778 INFO [Listener at localhost/33869] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-15 21:10:51,779 INFO [Listener at localhost/33869] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 21:10:51,779 INFO [Listener at localhost/33869] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-15 21:10:51,779 INFO [Listener at localhost/33869] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-15 21:10:51,779 INFO [Listener at localhost/33869] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 21:10:51,779 INFO [Listener at localhost/33869] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-15 21:10:51,784 INFO [Listener at localhost/33869] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-15 21:10:51,789 INFO [Listener at localhost/33869] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44797 2023-07-15 21:10:51,792 INFO [Listener at localhost/33869] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-15 21:10:51,811 DEBUG [Listener at localhost/33869] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-15 21:10:51,812 INFO [Listener at localhost/33869] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 21:10:51,815 INFO [Listener at localhost/33869] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 21:10:51,818 INFO [Listener at localhost/33869] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44797 connecting to ZooKeeper ensemble=127.0.0.1:57175 2023-07-15 21:10:51,826 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:447970x0, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-15 21:10:51,827 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:44797-0x1016ad2d8110001 connected 2023-07-15 21:10:51,827 DEBUG [Listener at localhost/33869] zookeeper.ZKUtil(164): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-15 21:10:51,829 DEBUG [Listener at localhost/33869] zookeeper.ZKUtil(164): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 21:10:51,830 DEBUG [Listener at localhost/33869] zookeeper.ZKUtil(164): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-15 21:10:51,839 DEBUG [Listener at localhost/33869] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44797 2023-07-15 21:10:51,840 DEBUG [Listener at localhost/33869] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44797 2023-07-15 21:10:51,841 DEBUG [Listener at localhost/33869] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44797 2023-07-15 21:10:51,843 DEBUG [Listener at localhost/33869] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44797 2023-07-15 21:10:51,843 DEBUG [Listener at localhost/33869] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44797 2023-07-15 21:10:51,863 INFO [Listener at localhost/33869] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-15 21:10:51,864 INFO [Listener at localhost/33869] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 21:10:51,864 INFO [Listener at localhost/33869] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-15 21:10:51,865 INFO [Listener at localhost/33869] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-15 21:10:51,865 INFO [Listener at localhost/33869] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 21:10:51,865 INFO [Listener at localhost/33869] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-15 21:10:51,866 INFO [Listener at localhost/33869] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-15 21:10:51,870 INFO [Listener at localhost/33869] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38601 2023-07-15 21:10:51,871 INFO [Listener at localhost/33869] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-15 21:10:51,874 DEBUG [Listener at localhost/33869] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-15 21:10:51,876 INFO [Listener at localhost/33869] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 21:10:51,878 INFO [Listener at localhost/33869] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 21:10:51,880 INFO [Listener at localhost/33869] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38601 connecting to ZooKeeper ensemble=127.0.0.1:57175 2023-07-15 21:10:51,886 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:386010x0, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-15 21:10:51,887 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:38601-0x1016ad2d8110002 connected 2023-07-15 21:10:51,887 DEBUG [Listener at localhost/33869] zookeeper.ZKUtil(164): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-15 21:10:51,888 DEBUG [Listener at localhost/33869] zookeeper.ZKUtil(164): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 21:10:51,889 DEBUG [Listener at localhost/33869] zookeeper.ZKUtil(164): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-15 21:10:51,894 DEBUG [Listener at localhost/33869] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38601 2023-07-15 21:10:51,895 DEBUG [Listener at localhost/33869] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38601 2023-07-15 21:10:51,899 DEBUG [Listener at localhost/33869] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38601 2023-07-15 21:10:51,899 DEBUG [Listener at localhost/33869] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38601 2023-07-15 21:10:51,900 DEBUG [Listener at localhost/33869] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38601 2023-07-15 21:10:51,912 INFO [Listener at localhost/33869] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-15 21:10:51,913 INFO [Listener at localhost/33869] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 21:10:51,913 INFO [Listener at localhost/33869] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-15 21:10:51,913 INFO [Listener at localhost/33869] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-15 21:10:51,913 INFO [Listener at localhost/33869] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 21:10:51,913 INFO [Listener at localhost/33869] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-15 21:10:51,914 INFO [Listener at localhost/33869] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-15 21:10:51,915 INFO [Listener at localhost/33869] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35469 2023-07-15 21:10:51,916 INFO [Listener at localhost/33869] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-15 21:10:51,917 DEBUG [Listener at localhost/33869] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-15 21:10:51,918 INFO [Listener at localhost/33869] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 21:10:51,921 INFO [Listener at localhost/33869] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 21:10:51,923 INFO [Listener at localhost/33869] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35469 connecting to ZooKeeper ensemble=127.0.0.1:57175 2023-07-15 21:10:51,932 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:354690x0, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-15 21:10:51,933 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:35469-0x1016ad2d8110003 connected 2023-07-15 21:10:51,933 DEBUG [Listener at localhost/33869] zookeeper.ZKUtil(164): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-15 21:10:51,934 DEBUG [Listener at localhost/33869] zookeeper.ZKUtil(164): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 21:10:51,935 DEBUG [Listener at localhost/33869] zookeeper.ZKUtil(164): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-15 21:10:51,938 DEBUG [Listener at localhost/33869] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35469 2023-07-15 21:10:51,941 DEBUG [Listener at localhost/33869] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35469 2023-07-15 21:10:51,942 DEBUG [Listener at localhost/33869] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35469 2023-07-15 21:10:51,943 DEBUG [Listener at localhost/33869] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35469 2023-07-15 21:10:51,943 DEBUG [Listener at localhost/33869] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35469 2023-07-15 21:10:51,948 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,44929,1689455450325 2023-07-15 21:10:51,958 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-15 21:10:51,961 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,44929,1689455450325 2023-07-15 21:10:51,987 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-15 21:10:51,988 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-15 21:10:51,987 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-15 21:10:51,987 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-15 21:10:51,988 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 21:10:51,990 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-15 21:10:51,991 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,44929,1689455450325 from backup master directory 2023-07-15 21:10:51,991 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-15 21:10:51,996 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,44929,1689455450325 2023-07-15 21:10:51,996 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-15 21:10:51,997 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-15 21:10:51,997 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,44929,1689455450325 2023-07-15 21:10:52,001 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-15 21:10:52,007 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-15 21:10:52,124 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/hbase.id with ID: 520a24dd-7a73-4977-9faa-ed7a62c33ffe 2023-07-15 21:10:52,191 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 21:10:52,208 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 21:10:52,278 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x32c428a1 to 127.0.0.1:57175 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 21:10:52,330 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@16ccf024, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 21:10:52,367 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-15 21:10:52,369 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-15 21:10:52,395 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-15 21:10:52,396 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-15 21:10:52,398 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-15 21:10:52,404 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-15 21:10:52,406 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-15 21:10:52,455 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/MasterData/data/master/store-tmp 2023-07-15 21:10:52,519 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:10:52,519 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-15 21:10:52,519 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 21:10:52,519 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 21:10:52,519 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-15 21:10:52,520 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 21:10:52,520 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 21:10:52,520 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-15 21:10:52,522 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/MasterData/WALs/jenkins-hbase4.apache.org,44929,1689455450325 2023-07-15 21:10:52,553 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44929%2C1689455450325, suffix=, logDir=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/MasterData/WALs/jenkins-hbase4.apache.org,44929,1689455450325, archiveDir=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/MasterData/oldWALs, maxLogs=10 2023-07-15 21:10:52,629 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38767,DS-0010cdf8-832e-45a0-9524-30448d7cf0af,DISK] 2023-07-15 21:10:52,629 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40561,DS-ea74c57e-1dec-4aa7-a28c-083a664bfded,DISK] 2023-07-15 21:10:52,629 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40619,DS-84fa3c94-a8f2-4f8b-807c-b6cef7a50dee,DISK] 2023-07-15 21:10:52,639 DEBUG [RS-EventLoopGroup-5-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-15 21:10:52,725 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/MasterData/WALs/jenkins-hbase4.apache.org,44929,1689455450325/jenkins-hbase4.apache.org%2C44929%2C1689455450325.1689455452565 2023-07-15 21:10:52,725 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40619,DS-84fa3c94-a8f2-4f8b-807c-b6cef7a50dee,DISK], DatanodeInfoWithStorage[127.0.0.1:38767,DS-0010cdf8-832e-45a0-9524-30448d7cf0af,DISK], DatanodeInfoWithStorage[127.0.0.1:40561,DS-ea74c57e-1dec-4aa7-a28c-083a664bfded,DISK]] 2023-07-15 21:10:52,726 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-15 21:10:52,726 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:10:52,730 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-15 21:10:52,731 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-15 21:10:52,825 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-15 21:10:52,834 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-15 21:10:52,875 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-15 21:10:52,891 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 21:10:52,898 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-15 21:10:52,900 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-15 21:10:52,919 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-15 21:10:52,925 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 21:10:52,926 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59890673, jitterRate=-0.10755942761898041}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 21:10:52,926 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-15 21:10:52,928 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-15 21:10:52,953 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-15 21:10:52,953 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-15 21:10:52,956 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-15 21:10:52,958 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-15 21:10:53,011 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 52 msec 2023-07-15 21:10:53,011 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-15 21:10:53,051 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-15 21:10:53,058 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-15 21:10:53,086 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-15 21:10:53,093 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-15 21:10:53,094 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-15 21:10:53,100 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-15 21:10:53,105 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-15 21:10:53,109 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 21:10:53,112 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-15 21:10:53,113 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-15 21:10:53,132 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-15 21:10:53,138 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-15 21:10:53,138 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-15 21:10:53,138 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-15 21:10:53,138 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-15 21:10:53,139 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 21:10:53,142 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,44929,1689455450325, sessionid=0x1016ad2d8110000, setting cluster-up flag (Was=false) 2023-07-15 21:10:53,162 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 21:10:53,178 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-15 21:10:53,179 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,44929,1689455450325 2023-07-15 21:10:53,185 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 21:10:53,192 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-15 21:10:53,194 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,44929,1689455450325 2023-07-15 21:10:53,196 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/.tmp 2023-07-15 21:10:53,259 INFO [RS:0;jenkins-hbase4:44797] regionserver.HRegionServer(951): ClusterId : 520a24dd-7a73-4977-9faa-ed7a62c33ffe 2023-07-15 21:10:53,267 INFO [RS:1;jenkins-hbase4:38601] regionserver.HRegionServer(951): ClusterId : 520a24dd-7a73-4977-9faa-ed7a62c33ffe 2023-07-15 21:10:53,285 INFO [RS:2;jenkins-hbase4:35469] regionserver.HRegionServer(951): ClusterId : 520a24dd-7a73-4977-9faa-ed7a62c33ffe 2023-07-15 21:10:53,285 DEBUG [RS:1;jenkins-hbase4:38601] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-15 21:10:53,285 DEBUG [RS:0;jenkins-hbase4:44797] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-15 21:10:53,289 DEBUG [RS:2;jenkins-hbase4:35469] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-15 21:10:53,295 DEBUG [RS:2;jenkins-hbase4:35469] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-15 21:10:53,295 DEBUG [RS:0;jenkins-hbase4:44797] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-15 21:10:53,295 DEBUG [RS:2;jenkins-hbase4:35469] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-15 21:10:53,295 DEBUG [RS:0;jenkins-hbase4:44797] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-15 21:10:53,299 DEBUG [RS:1;jenkins-hbase4:38601] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-15 21:10:53,300 DEBUG [RS:1;jenkins-hbase4:38601] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-15 21:10:53,303 DEBUG [RS:0;jenkins-hbase4:44797] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-15 21:10:53,305 DEBUG [RS:0;jenkins-hbase4:44797] zookeeper.ReadOnlyZKClient(139): Connect 0x0dd3a702 to 127.0.0.1:57175 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 21:10:53,306 DEBUG [RS:1;jenkins-hbase4:38601] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-15 21:10:53,307 DEBUG [RS:2;jenkins-hbase4:35469] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-15 21:10:53,309 DEBUG [RS:1;jenkins-hbase4:38601] zookeeper.ReadOnlyZKClient(139): Connect 0x1c87e184 to 127.0.0.1:57175 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 21:10:53,309 DEBUG [RS:2;jenkins-hbase4:35469] zookeeper.ReadOnlyZKClient(139): Connect 0x4303c312 to 127.0.0.1:57175 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 21:10:53,334 DEBUG [RS:0;jenkins-hbase4:44797] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@71a401cf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 21:10:53,335 DEBUG [RS:1;jenkins-hbase4:38601] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6e99cabc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 21:10:53,335 DEBUG [RS:0;jenkins-hbase4:44797] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7d03f762, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-15 21:10:53,335 DEBUG [RS:1;jenkins-hbase4:38601] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@11ae56f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-15 21:10:53,341 DEBUG [RS:2;jenkins-hbase4:35469] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6014516, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 21:10:53,341 DEBUG [RS:2;jenkins-hbase4:35469] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@12ad450c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-15 21:10:53,356 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-15 21:10:53,363 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 21:10:53,364 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-15 21:10:53,372 DEBUG [RS:2;jenkins-hbase4:35469] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:35469 2023-07-15 21:10:53,375 DEBUG [RS:0;jenkins-hbase4:44797] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:44797 2023-07-15 21:10:53,383 INFO [RS:2;jenkins-hbase4:35469] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-15 21:10:53,383 INFO [RS:0;jenkins-hbase4:44797] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-15 21:10:53,384 INFO [RS:0;jenkins-hbase4:44797] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-15 21:10:53,384 INFO [RS:2;jenkins-hbase4:35469] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-15 21:10:53,384 DEBUG [RS:2;jenkins-hbase4:35469] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-15 21:10:53,384 DEBUG [RS:0;jenkins-hbase4:44797] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-15 21:10:53,386 INFO [RS:0;jenkins-hbase4:44797] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 21:10:53,386 INFO [RS:2;jenkins-hbase4:35469] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 21:10:53,386 DEBUG [RS:2;jenkins-hbase4:35469] regionserver.HRegionServer(1022): About to register with Master. 2023-07-15 21:10:53,386 DEBUG [RS:0;jenkins-hbase4:44797] regionserver.HRegionServer(1022): About to register with Master. 2023-07-15 21:10:53,389 INFO [RS:0;jenkins-hbase4:44797] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,44929,1689455450325 with isa=jenkins-hbase4.apache.org/172.31.14.131:44797, startcode=1689455451778 2023-07-15 21:10:53,389 INFO [RS:2;jenkins-hbase4:35469] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,44929,1689455450325 with isa=jenkins-hbase4.apache.org/172.31.14.131:35469, startcode=1689455451912 2023-07-15 21:10:53,411 DEBUG [RS:0;jenkins-hbase4:44797] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-15 21:10:53,411 DEBUG [RS:2;jenkins-hbase4:35469] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-15 21:10:53,422 DEBUG [RS:1;jenkins-hbase4:38601] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:38601 2023-07-15 21:10:53,422 INFO [RS:1;jenkins-hbase4:38601] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-15 21:10:53,422 INFO [RS:1;jenkins-hbase4:38601] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-15 21:10:53,423 DEBUG [RS:1;jenkins-hbase4:38601] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-15 21:10:53,423 INFO [RS:1;jenkins-hbase4:38601] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 21:10:53,423 DEBUG [RS:1;jenkins-hbase4:38601] regionserver.HRegionServer(1022): About to register with Master. 2023-07-15 21:10:53,424 INFO [RS:1;jenkins-hbase4:38601] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,44929,1689455450325 with isa=jenkins-hbase4.apache.org/172.31.14.131:38601, startcode=1689455451863 2023-07-15 21:10:53,425 DEBUG [RS:1;jenkins-hbase4:38601] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-15 21:10:53,497 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-15 21:10:53,500 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49715, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-15 21:10:53,501 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49565, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-15 21:10:53,501 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52227, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-15 21:10:53,516 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44929] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-15 21:10:53,530 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44929] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-15 21:10:53,534 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-15 21:10:53,534 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-15 21:10:53,538 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44929] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-15 21:10:53,538 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-15 21:10:53,539 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-15 21:10:53,540 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-15 21:10:53,540 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 21:10:53,540 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-15 21:10:53,540 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 21:10:53,551 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689455483551 2023-07-15 21:10:53,555 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-15 21:10:53,559 DEBUG [PEWorker-2] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-15 21:10:53,559 DEBUG [RS:0;jenkins-hbase4:44797] regionserver.HRegionServer(2830): Master is not running yet 2023-07-15 21:10:53,559 DEBUG [RS:1;jenkins-hbase4:38601] regionserver.HRegionServer(2830): Master is not running yet 2023-07-15 21:10:53,560 WARN [RS:1;jenkins-hbase4:38601] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-15 21:10:53,560 WARN [RS:0;jenkins-hbase4:44797] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-15 21:10:53,560 INFO [PEWorker-2] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-15 21:10:53,562 DEBUG [RS:2;jenkins-hbase4:35469] regionserver.HRegionServer(2830): Master is not running yet 2023-07-15 21:10:53,563 WARN [RS:2;jenkins-hbase4:35469] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-15 21:10:53,566 INFO [PEWorker-2] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-15 21:10:53,571 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-15 21:10:53,587 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-15 21:10:53,587 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-15 21:10:53,588 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-15 21:10:53,588 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-15 21:10:53,589 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-15 21:10:53,590 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-15 21:10:53,593 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-15 21:10:53,594 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-15 21:10:53,598 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-15 21:10:53,598 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-15 21:10:53,600 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689455453600,5,FailOnTimeoutGroup] 2023-07-15 21:10:53,603 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689455453600,5,FailOnTimeoutGroup] 2023-07-15 21:10:53,604 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-15 21:10:53,604 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-15 21:10:53,606 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-15 21:10:53,606 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-15 21:10:53,641 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-15 21:10:53,643 INFO [PEWorker-2] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-15 21:10:53,643 INFO [PEWorker-2] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f 2023-07-15 21:10:53,661 INFO [RS:1;jenkins-hbase4:38601] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,44929,1689455450325 with isa=jenkins-hbase4.apache.org/172.31.14.131:38601, startcode=1689455451863 2023-07-15 21:10:53,661 INFO [RS:0;jenkins-hbase4:44797] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,44929,1689455450325 with isa=jenkins-hbase4.apache.org/172.31.14.131:44797, startcode=1689455451778 2023-07-15 21:10:53,664 INFO [RS:2;jenkins-hbase4:35469] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,44929,1689455450325 with isa=jenkins-hbase4.apache.org/172.31.14.131:35469, startcode=1689455451912 2023-07-15 21:10:53,671 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44929] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:10:53,683 DEBUG [PEWorker-2] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:10:53,684 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44929] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:10:53,685 DEBUG [RS:1;jenkins-hbase4:38601] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f 2023-07-15 21:10:53,685 DEBUG [RS:1;jenkins-hbase4:38601] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:45529 2023-07-15 21:10:53,685 DEBUG [RS:1;jenkins-hbase4:38601] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-15 21:10:53,685 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44929] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:10:53,688 DEBUG [RS:0;jenkins-hbase4:44797] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f 2023-07-15 21:10:53,688 DEBUG [RS:0;jenkins-hbase4:44797] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:45529 2023-07-15 21:10:53,688 DEBUG [RS:0;jenkins-hbase4:44797] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-15 21:10:53,689 DEBUG [RS:2;jenkins-hbase4:35469] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f 2023-07-15 21:10:53,689 DEBUG [RS:2;jenkins-hbase4:35469] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:45529 2023-07-15 21:10:53,689 DEBUG [RS:2;jenkins-hbase4:35469] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-15 21:10:53,691 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-15 21:10:53,699 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-15 21:10:53,699 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/hbase/meta/1588230740/info 2023-07-15 21:10:53,700 DEBUG [RS:2;jenkins-hbase4:35469] zookeeper.ZKUtil(162): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:10:53,700 WARN [RS:2;jenkins-hbase4:35469] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-15 21:10:53,701 INFO [RS:2;jenkins-hbase4:35469] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-15 21:10:53,701 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-15 21:10:53,701 DEBUG [RS:0;jenkins-hbase4:44797] zookeeper.ZKUtil(162): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:10:53,701 DEBUG [RS:2;jenkins-hbase4:35469] regionserver.HRegionServer(1948): logDir=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/WALs/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:10:53,701 WARN [RS:0;jenkins-hbase4:44797] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-15 21:10:53,701 DEBUG [RS:1;jenkins-hbase4:38601] zookeeper.ZKUtil(162): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:10:53,702 WARN [RS:1;jenkins-hbase4:38601] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-15 21:10:53,702 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,44797,1689455451778] 2023-07-15 21:10:53,702 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,35469,1689455451912] 2023-07-15 21:10:53,702 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,38601,1689455451863] 2023-07-15 21:10:53,702 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 21:10:53,702 INFO [RS:0;jenkins-hbase4:44797] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-15 21:10:53,703 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-15 21:10:53,702 INFO [RS:1;jenkins-hbase4:38601] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-15 21:10:53,704 DEBUG [RS:0;jenkins-hbase4:44797] regionserver.HRegionServer(1948): logDir=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/WALs/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:10:53,705 DEBUG [RS:1;jenkins-hbase4:38601] regionserver.HRegionServer(1948): logDir=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/WALs/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:10:53,710 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/hbase/meta/1588230740/rep_barrier 2023-07-15 21:10:53,717 DEBUG [RS:2;jenkins-hbase4:35469] zookeeper.ZKUtil(162): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:10:53,718 DEBUG [RS:1;jenkins-hbase4:38601] zookeeper.ZKUtil(162): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:10:53,718 DEBUG [RS:0;jenkins-hbase4:44797] zookeeper.ZKUtil(162): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:10:53,718 DEBUG [RS:2;jenkins-hbase4:35469] zookeeper.ZKUtil(162): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:10:53,719 DEBUG [RS:0;jenkins-hbase4:44797] zookeeper.ZKUtil(162): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:10:53,719 DEBUG [RS:1;jenkins-hbase4:38601] zookeeper.ZKUtil(162): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:10:53,719 DEBUG [RS:0;jenkins-hbase4:44797] zookeeper.ZKUtil(162): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:10:53,719 DEBUG [RS:2;jenkins-hbase4:35469] zookeeper.ZKUtil(162): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:10:53,720 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-15 21:10:53,720 DEBUG [RS:1;jenkins-hbase4:38601] zookeeper.ZKUtil(162): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:10:53,721 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 21:10:53,723 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-15 21:10:53,725 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/hbase/meta/1588230740/table 2023-07-15 21:10:53,726 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-15 21:10:53,731 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 21:10:53,735 DEBUG [PEWorker-2] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/hbase/meta/1588230740 2023-07-15 21:10:53,736 DEBUG [PEWorker-2] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/hbase/meta/1588230740 2023-07-15 21:10:53,738 DEBUG [RS:1;jenkins-hbase4:38601] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-15 21:10:53,738 DEBUG [RS:2;jenkins-hbase4:35469] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-15 21:10:53,738 DEBUG [RS:0;jenkins-hbase4:44797] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-15 21:10:53,742 DEBUG [PEWorker-2] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-15 21:10:53,750 INFO [RS:2;jenkins-hbase4:35469] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-15 21:10:53,754 INFO [RS:1;jenkins-hbase4:38601] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-15 21:10:53,750 INFO [RS:0;jenkins-hbase4:44797] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-15 21:10:53,755 DEBUG [PEWorker-2] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-15 21:10:53,759 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 21:10:53,762 INFO [PEWorker-2] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69831869, jitterRate=0.04057593643665314}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-15 21:10:53,762 DEBUG [PEWorker-2] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-15 21:10:53,762 DEBUG [PEWorker-2] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-15 21:10:53,762 INFO [PEWorker-2] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-15 21:10:53,762 DEBUG [PEWorker-2] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-15 21:10:53,762 DEBUG [PEWorker-2] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-15 21:10:53,763 DEBUG [PEWorker-2] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-15 21:10:53,764 INFO [PEWorker-2] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-15 21:10:53,764 DEBUG [PEWorker-2] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-15 21:10:53,776 DEBUG [PEWorker-2] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-15 21:10:53,776 INFO [PEWorker-2] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-15 21:10:53,784 INFO [RS:0;jenkins-hbase4:44797] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-15 21:10:53,784 INFO [RS:2;jenkins-hbase4:35469] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-15 21:10:53,784 INFO [RS:1;jenkins-hbase4:38601] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-15 21:10:53,790 INFO [RS:2;jenkins-hbase4:35469] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-15 21:10:53,790 INFO [RS:2;jenkins-hbase4:35469] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 21:10:53,790 INFO [RS:0;jenkins-hbase4:44797] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-15 21:10:53,791 INFO [RS:1;jenkins-hbase4:38601] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-15 21:10:53,791 INFO [RS:0;jenkins-hbase4:44797] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 21:10:53,791 INFO [RS:1;jenkins-hbase4:38601] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 21:10:53,795 INFO [RS:2;jenkins-hbase4:35469] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-15 21:10:53,795 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-15 21:10:53,799 INFO [RS:0;jenkins-hbase4:44797] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-15 21:10:53,799 INFO [RS:1;jenkins-hbase4:38601] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-15 21:10:53,808 INFO [RS:0;jenkins-hbase4:44797] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-15 21:10:53,808 INFO [RS:2;jenkins-hbase4:35469] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-15 21:10:53,808 INFO [RS:1;jenkins-hbase4:38601] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-15 21:10:53,809 DEBUG [RS:2;jenkins-hbase4:35469] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 21:10:53,809 DEBUG [RS:0;jenkins-hbase4:44797] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 21:10:53,810 DEBUG [RS:1;jenkins-hbase4:38601] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 21:10:53,810 DEBUG [RS:0;jenkins-hbase4:44797] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 21:10:53,810 DEBUG [RS:1;jenkins-hbase4:38601] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 21:10:53,810 DEBUG [RS:2;jenkins-hbase4:35469] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 21:10:53,810 DEBUG [RS:1;jenkins-hbase4:38601] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 21:10:53,810 DEBUG [RS:2;jenkins-hbase4:35469] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 21:10:53,810 DEBUG [RS:1;jenkins-hbase4:38601] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 21:10:53,810 DEBUG [RS:2;jenkins-hbase4:35469] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 21:10:53,810 DEBUG [RS:1;jenkins-hbase4:38601] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 21:10:53,810 DEBUG [RS:2;jenkins-hbase4:35469] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 21:10:53,810 DEBUG [RS:1;jenkins-hbase4:38601] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-15 21:10:53,810 DEBUG [RS:2;jenkins-hbase4:35469] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-15 21:10:53,810 DEBUG [RS:0;jenkins-hbase4:44797] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 21:10:53,810 DEBUG [RS:2;jenkins-hbase4:35469] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 21:10:53,811 DEBUG [RS:0;jenkins-hbase4:44797] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 21:10:53,811 DEBUG [RS:2;jenkins-hbase4:35469] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 21:10:53,811 DEBUG [RS:0;jenkins-hbase4:44797] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 21:10:53,811 DEBUG [RS:0;jenkins-hbase4:44797] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-15 21:10:53,811 DEBUG [RS:0;jenkins-hbase4:44797] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 21:10:53,811 DEBUG [RS:0;jenkins-hbase4:44797] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 21:10:53,811 DEBUG [RS:0;jenkins-hbase4:44797] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 21:10:53,811 DEBUG [RS:0;jenkins-hbase4:44797] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 21:10:53,810 DEBUG [RS:1;jenkins-hbase4:38601] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 21:10:53,812 DEBUG [RS:1;jenkins-hbase4:38601] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 21:10:53,812 DEBUG [RS:1;jenkins-hbase4:38601] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 21:10:53,811 DEBUG [RS:2;jenkins-hbase4:35469] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 21:10:53,812 DEBUG [RS:2;jenkins-hbase4:35469] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 21:10:53,812 DEBUG [RS:1;jenkins-hbase4:38601] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 21:10:53,819 INFO [RS:1;jenkins-hbase4:38601] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-15 21:10:53,819 INFO [RS:1;jenkins-hbase4:38601] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-15 21:10:53,819 INFO [RS:1;jenkins-hbase4:38601] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-15 21:10:53,819 INFO [RS:2;jenkins-hbase4:35469] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-15 21:10:53,819 INFO [RS:2;jenkins-hbase4:35469] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-15 21:10:53,819 INFO [RS:2;jenkins-hbase4:35469] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-15 21:10:53,827 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-15 21:10:53,834 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-15 21:10:53,846 INFO [RS:0;jenkins-hbase4:44797] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-15 21:10:53,847 INFO [RS:0;jenkins-hbase4:44797] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-15 21:10:53,847 INFO [RS:0;jenkins-hbase4:44797] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-15 21:10:53,851 INFO [RS:1;jenkins-hbase4:38601] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-15 21:10:53,855 INFO [RS:1;jenkins-hbase4:38601] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38601,1689455451863-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 21:10:53,855 INFO [RS:2;jenkins-hbase4:35469] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-15 21:10:53,858 INFO [RS:2;jenkins-hbase4:35469] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35469,1689455451912-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 21:10:53,873 INFO [RS:0;jenkins-hbase4:44797] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-15 21:10:53,874 INFO [RS:0;jenkins-hbase4:44797] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44797,1689455451778-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 21:10:53,891 INFO [RS:2;jenkins-hbase4:35469] regionserver.Replication(203): jenkins-hbase4.apache.org,35469,1689455451912 started 2023-07-15 21:10:53,891 INFO [RS:1;jenkins-hbase4:38601] regionserver.Replication(203): jenkins-hbase4.apache.org,38601,1689455451863 started 2023-07-15 21:10:53,891 INFO [RS:1;jenkins-hbase4:38601] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,38601,1689455451863, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:38601, sessionid=0x1016ad2d8110002 2023-07-15 21:10:53,891 DEBUG [RS:1;jenkins-hbase4:38601] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-15 21:10:53,891 DEBUG [RS:1;jenkins-hbase4:38601] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:10:53,891 DEBUG [RS:1;jenkins-hbase4:38601] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38601,1689455451863' 2023-07-15 21:10:53,892 DEBUG [RS:1;jenkins-hbase4:38601] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 21:10:53,891 INFO [RS:2;jenkins-hbase4:35469] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,35469,1689455451912, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:35469, sessionid=0x1016ad2d8110003 2023-07-15 21:10:53,892 DEBUG [RS:1;jenkins-hbase4:38601] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 21:10:53,892 DEBUG [RS:2;jenkins-hbase4:35469] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-15 21:10:53,893 DEBUG [RS:2;jenkins-hbase4:35469] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:10:53,894 DEBUG [RS:1;jenkins-hbase4:38601] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-15 21:10:53,896 DEBUG [RS:1;jenkins-hbase4:38601] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-15 21:10:53,895 DEBUG [RS:2;jenkins-hbase4:35469] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35469,1689455451912' 2023-07-15 21:10:53,896 DEBUG [RS:2;jenkins-hbase4:35469] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 21:10:53,896 DEBUG [RS:1;jenkins-hbase4:38601] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:10:53,898 DEBUG [RS:2;jenkins-hbase4:35469] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 21:10:53,899 DEBUG [RS:1;jenkins-hbase4:38601] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38601,1689455451863' 2023-07-15 21:10:53,900 DEBUG [RS:1;jenkins-hbase4:38601] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:10:53,900 INFO [RS:0;jenkins-hbase4:44797] regionserver.Replication(203): jenkins-hbase4.apache.org,44797,1689455451778 started 2023-07-15 21:10:53,900 INFO [RS:0;jenkins-hbase4:44797] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,44797,1689455451778, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:44797, sessionid=0x1016ad2d8110001 2023-07-15 21:10:53,900 DEBUG [RS:0;jenkins-hbase4:44797] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-15 21:10:53,900 DEBUG [RS:0;jenkins-hbase4:44797] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:10:53,900 DEBUG [RS:0;jenkins-hbase4:44797] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44797,1689455451778' 2023-07-15 21:10:53,900 DEBUG [RS:0;jenkins-hbase4:44797] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 21:10:53,900 DEBUG [RS:1;jenkins-hbase4:38601] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:10:53,900 DEBUG [RS:2;jenkins-hbase4:35469] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-15 21:10:53,901 DEBUG [RS:2;jenkins-hbase4:35469] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-15 21:10:53,901 DEBUG [RS:2;jenkins-hbase4:35469] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:10:53,902 DEBUG [RS:2;jenkins-hbase4:35469] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35469,1689455451912' 2023-07-15 21:10:53,902 DEBUG [RS:2;jenkins-hbase4:35469] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:10:53,902 DEBUG [RS:1;jenkins-hbase4:38601] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-15 21:10:53,902 INFO [RS:1;jenkins-hbase4:38601] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-15 21:10:53,902 DEBUG [RS:0;jenkins-hbase4:44797] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 21:10:53,902 INFO [RS:1;jenkins-hbase4:38601] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-15 21:10:53,903 DEBUG [RS:2;jenkins-hbase4:35469] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:10:53,903 DEBUG [RS:0;jenkins-hbase4:44797] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-15 21:10:53,903 DEBUG [RS:0;jenkins-hbase4:44797] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-15 21:10:53,903 DEBUG [RS:0;jenkins-hbase4:44797] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:10:53,903 DEBUG [RS:0;jenkins-hbase4:44797] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44797,1689455451778' 2023-07-15 21:10:53,904 DEBUG [RS:0;jenkins-hbase4:44797] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:10:53,911 DEBUG [RS:2;jenkins-hbase4:35469] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-15 21:10:53,911 DEBUG [RS:0;jenkins-hbase4:44797] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:10:53,911 INFO [RS:2;jenkins-hbase4:35469] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-15 21:10:53,912 INFO [RS:2;jenkins-hbase4:35469] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-15 21:10:53,913 DEBUG [RS:0;jenkins-hbase4:44797] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-15 21:10:53,913 INFO [RS:0;jenkins-hbase4:44797] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-15 21:10:53,913 INFO [RS:0;jenkins-hbase4:44797] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-15 21:10:53,987 DEBUG [jenkins-hbase4:44929] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-15 21:10:53,992 DEBUG [jenkins-hbase4:44929] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 21:10:53,999 DEBUG [jenkins-hbase4:44929] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 21:10:53,999 DEBUG [jenkins-hbase4:44929] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 21:10:53,999 DEBUG [jenkins-hbase4:44929] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 21:10:53,999 DEBUG [jenkins-hbase4:44929] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 21:10:54,003 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38601,1689455451863, state=OPENING 2023-07-15 21:10:54,013 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-15 21:10:54,015 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 21:10:54,016 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-15 21:10:54,017 INFO [RS:0;jenkins-hbase4:44797] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44797%2C1689455451778, suffix=, logDir=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/WALs/jenkins-hbase4.apache.org,44797,1689455451778, archiveDir=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/oldWALs, maxLogs=32 2023-07-15 21:10:54,025 INFO [RS:2;jenkins-hbase4:35469] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35469%2C1689455451912, suffix=, logDir=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/WALs/jenkins-hbase4.apache.org,35469,1689455451912, archiveDir=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/oldWALs, maxLogs=32 2023-07-15 21:10:54,037 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38601,1689455451863}] 2023-07-15 21:10:54,050 INFO [RS:1;jenkins-hbase4:38601] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38601%2C1689455451863, suffix=, logDir=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/WALs/jenkins-hbase4.apache.org,38601,1689455451863, archiveDir=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/oldWALs, maxLogs=32 2023-07-15 21:10:54,113 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38767,DS-0010cdf8-832e-45a0-9524-30448d7cf0af,DISK] 2023-07-15 21:10:54,114 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40561,DS-ea74c57e-1dec-4aa7-a28c-083a664bfded,DISK] 2023-07-15 21:10:54,114 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40619,DS-84fa3c94-a8f2-4f8b-807c-b6cef7a50dee,DISK] 2023-07-15 21:10:54,140 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40561,DS-ea74c57e-1dec-4aa7-a28c-083a664bfded,DISK] 2023-07-15 21:10:54,141 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38767,DS-0010cdf8-832e-45a0-9524-30448d7cf0af,DISK] 2023-07-15 21:10:54,141 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40619,DS-84fa3c94-a8f2-4f8b-807c-b6cef7a50dee,DISK] 2023-07-15 21:10:54,143 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40561,DS-ea74c57e-1dec-4aa7-a28c-083a664bfded,DISK] 2023-07-15 21:10:54,144 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40619,DS-84fa3c94-a8f2-4f8b-807c-b6cef7a50dee,DISK] 2023-07-15 21:10:54,154 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38767,DS-0010cdf8-832e-45a0-9524-30448d7cf0af,DISK] 2023-07-15 21:10:54,157 INFO [RS:2;jenkins-hbase4:35469] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/WALs/jenkins-hbase4.apache.org,35469,1689455451912/jenkins-hbase4.apache.org%2C35469%2C1689455451912.1689455454029 2023-07-15 21:10:54,163 INFO [RS:0;jenkins-hbase4:44797] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/WALs/jenkins-hbase4.apache.org,44797,1689455451778/jenkins-hbase4.apache.org%2C44797%2C1689455451778.1689455454042 2023-07-15 21:10:54,171 DEBUG [RS:2;jenkins-hbase4:35469] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40561,DS-ea74c57e-1dec-4aa7-a28c-083a664bfded,DISK], DatanodeInfoWithStorage[127.0.0.1:38767,DS-0010cdf8-832e-45a0-9524-30448d7cf0af,DISK], DatanodeInfoWithStorage[127.0.0.1:40619,DS-84fa3c94-a8f2-4f8b-807c-b6cef7a50dee,DISK]] 2023-07-15 21:10:54,174 DEBUG [RS:0;jenkins-hbase4:44797] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40619,DS-84fa3c94-a8f2-4f8b-807c-b6cef7a50dee,DISK], DatanodeInfoWithStorage[127.0.0.1:38767,DS-0010cdf8-832e-45a0-9524-30448d7cf0af,DISK], DatanodeInfoWithStorage[127.0.0.1:40561,DS-ea74c57e-1dec-4aa7-a28c-083a664bfded,DISK]] 2023-07-15 21:10:54,176 INFO [RS:1;jenkins-hbase4:38601] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/WALs/jenkins-hbase4.apache.org,38601,1689455451863/jenkins-hbase4.apache.org%2C38601%2C1689455451863.1689455454052 2023-07-15 21:10:54,176 DEBUG [RS:1;jenkins-hbase4:38601] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40619,DS-84fa3c94-a8f2-4f8b-807c-b6cef7a50dee,DISK], DatanodeInfoWithStorage[127.0.0.1:40561,DS-ea74c57e-1dec-4aa7-a28c-083a664bfded,DISK], DatanodeInfoWithStorage[127.0.0.1:38767,DS-0010cdf8-832e-45a0-9524-30448d7cf0af,DISK]] 2023-07-15 21:10:54,345 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:10:54,349 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-15 21:10:54,359 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50370, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-15 21:10:54,385 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-15 21:10:54,385 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-15 21:10:54,390 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38601%2C1689455451863.meta, suffix=.meta, logDir=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/WALs/jenkins-hbase4.apache.org,38601,1689455451863, archiveDir=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/oldWALs, maxLogs=32 2023-07-15 21:10:54,424 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40561,DS-ea74c57e-1dec-4aa7-a28c-083a664bfded,DISK] 2023-07-15 21:10:54,433 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38767,DS-0010cdf8-832e-45a0-9524-30448d7cf0af,DISK] 2023-07-15 21:10:54,433 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40619,DS-84fa3c94-a8f2-4f8b-807c-b6cef7a50dee,DISK] 2023-07-15 21:10:54,453 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/WALs/jenkins-hbase4.apache.org,38601,1689455451863/jenkins-hbase4.apache.org%2C38601%2C1689455451863.meta.1689455454392.meta 2023-07-15 21:10:54,454 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40561,DS-ea74c57e-1dec-4aa7-a28c-083a664bfded,DISK], DatanodeInfoWithStorage[127.0.0.1:40619,DS-84fa3c94-a8f2-4f8b-807c-b6cef7a50dee,DISK], DatanodeInfoWithStorage[127.0.0.1:38767,DS-0010cdf8-832e-45a0-9524-30448d7cf0af,DISK]] 2023-07-15 21:10:54,455 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-15 21:10:54,456 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-15 21:10:54,457 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 21:10:54,458 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-15 21:10:54,461 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-15 21:10:54,463 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-15 21:10:54,477 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-15 21:10:54,477 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:10:54,478 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-15 21:10:54,478 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-15 21:10:54,483 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-15 21:10:54,487 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/hbase/meta/1588230740/info 2023-07-15 21:10:54,487 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/hbase/meta/1588230740/info 2023-07-15 21:10:54,488 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-15 21:10:54,489 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 21:10:54,489 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-15 21:10:54,491 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/hbase/meta/1588230740/rep_barrier 2023-07-15 21:10:54,491 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/hbase/meta/1588230740/rep_barrier 2023-07-15 21:10:54,492 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-15 21:10:54,493 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 21:10:54,493 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-15 21:10:54,495 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/hbase/meta/1588230740/table 2023-07-15 21:10:54,495 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/hbase/meta/1588230740/table 2023-07-15 21:10:54,495 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-15 21:10:54,496 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 21:10:54,499 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/hbase/meta/1588230740 2023-07-15 21:10:54,502 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/hbase/meta/1588230740 2023-07-15 21:10:54,506 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-15 21:10:54,512 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-15 21:10:54,513 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67143921, jitterRate=5.223900079727173E-4}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-15 21:10:54,516 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-15 21:10:54,530 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689455454334 2023-07-15 21:10:54,567 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-15 21:10:54,569 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-15 21:10:54,569 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38601,1689455451863, state=OPEN 2023-07-15 21:10:54,573 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-15 21:10:54,573 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-15 21:10:54,579 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-15 21:10:54,579 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38601,1689455451863 in 536 msec 2023-07-15 21:10:54,584 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-15 21:10:54,585 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 785 msec 2023-07-15 21:10:54,591 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.2170 sec 2023-07-15 21:10:54,591 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689455454591, completionTime=-1 2023-07-15 21:10:54,591 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-15 21:10:54,591 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-15 21:10:54,677 DEBUG [hconnection-0x7100f96f-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:10:54,682 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50382, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:10:54,724 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-15 21:10:54,724 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689455514724 2023-07-15 21:10:54,725 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689455574725 2023-07-15 21:10:54,725 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 133 msec 2023-07-15 21:10:54,765 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44929,1689455450325-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 21:10:54,765 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44929,1689455450325-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-15 21:10:54,766 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44929,1689455450325-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-15 21:10:54,770 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:44929, period=300000, unit=MILLISECONDS is enabled. 2023-07-15 21:10:54,771 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-15 21:10:54,789 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-15 21:10:54,808 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-15 21:10:54,816 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-15 21:10:54,831 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-15 21:10:54,833 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 21:10:54,836 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 21:10:54,863 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/hbase/namespace/51884e1d2b0369b46d228cfb948034dc 2023-07-15 21:10:54,866 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/hbase/namespace/51884e1d2b0369b46d228cfb948034dc empty. 2023-07-15 21:10:54,867 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/hbase/namespace/51884e1d2b0369b46d228cfb948034dc 2023-07-15 21:10:54,867 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-15 21:10:55,318 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-15 21:10:55,321 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 51884e1d2b0369b46d228cfb948034dc, NAME => 'hbase:namespace,,1689455454790.51884e1d2b0369b46d228cfb948034dc.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp 2023-07-15 21:10:55,342 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689455454790.51884e1d2b0369b46d228cfb948034dc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:10:55,342 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 51884e1d2b0369b46d228cfb948034dc, disabling compactions & flushes 2023-07-15 21:10:55,342 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689455454790.51884e1d2b0369b46d228cfb948034dc. 2023-07-15 21:10:55,342 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689455454790.51884e1d2b0369b46d228cfb948034dc. 2023-07-15 21:10:55,342 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689455454790.51884e1d2b0369b46d228cfb948034dc. after waiting 0 ms 2023-07-15 21:10:55,342 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689455454790.51884e1d2b0369b46d228cfb948034dc. 2023-07-15 21:10:55,343 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689455454790.51884e1d2b0369b46d228cfb948034dc. 2023-07-15 21:10:55,343 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 51884e1d2b0369b46d228cfb948034dc: 2023-07-15 21:10:55,347 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 21:10:55,366 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689455454790.51884e1d2b0369b46d228cfb948034dc.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689455455350"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689455455350"}]},"ts":"1689455455350"} 2023-07-15 21:10:55,394 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-15 21:10:55,397 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 21:10:55,403 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689455455397"}]},"ts":"1689455455397"} 2023-07-15 21:10:55,410 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-15 21:10:55,415 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 21:10:55,416 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 21:10:55,416 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 21:10:55,416 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 21:10:55,416 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 21:10:55,420 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=51884e1d2b0369b46d228cfb948034dc, ASSIGN}] 2023-07-15 21:10:55,424 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=51884e1d2b0369b46d228cfb948034dc, ASSIGN 2023-07-15 21:10:55,427 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=51884e1d2b0369b46d228cfb948034dc, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38601,1689455451863; forceNewPlan=false, retain=false 2023-07-15 21:10:55,579 INFO [jenkins-hbase4:44929] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-15 21:10:55,581 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=51884e1d2b0369b46d228cfb948034dc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:10:55,581 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689455454790.51884e1d2b0369b46d228cfb948034dc.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689455455580"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689455455580"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689455455580"}]},"ts":"1689455455580"} 2023-07-15 21:10:55,587 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 51884e1d2b0369b46d228cfb948034dc, server=jenkins-hbase4.apache.org,38601,1689455451863}] 2023-07-15 21:10:55,756 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689455454790.51884e1d2b0369b46d228cfb948034dc. 2023-07-15 21:10:55,756 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 51884e1d2b0369b46d228cfb948034dc, NAME => 'hbase:namespace,,1689455454790.51884e1d2b0369b46d228cfb948034dc.', STARTKEY => '', ENDKEY => ''} 2023-07-15 21:10:55,756 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689455454790.51884e1d2b0369b46d228cfb948034dc. service=AccessControlService 2023-07-15 21:10:55,758 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 21:10:55,758 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 51884e1d2b0369b46d228cfb948034dc 2023-07-15 21:10:55,759 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689455454790.51884e1d2b0369b46d228cfb948034dc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:10:55,759 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 51884e1d2b0369b46d228cfb948034dc 2023-07-15 21:10:55,759 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 51884e1d2b0369b46d228cfb948034dc 2023-07-15 21:10:55,767 INFO [StoreOpener-51884e1d2b0369b46d228cfb948034dc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 51884e1d2b0369b46d228cfb948034dc 2023-07-15 21:10:55,769 DEBUG [StoreOpener-51884e1d2b0369b46d228cfb948034dc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/hbase/namespace/51884e1d2b0369b46d228cfb948034dc/info 2023-07-15 21:10:55,769 DEBUG [StoreOpener-51884e1d2b0369b46d228cfb948034dc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/hbase/namespace/51884e1d2b0369b46d228cfb948034dc/info 2023-07-15 21:10:55,770 INFO [StoreOpener-51884e1d2b0369b46d228cfb948034dc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 51884e1d2b0369b46d228cfb948034dc columnFamilyName info 2023-07-15 21:10:55,771 INFO [StoreOpener-51884e1d2b0369b46d228cfb948034dc-1] regionserver.HStore(310): Store=51884e1d2b0369b46d228cfb948034dc/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 21:10:55,773 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/hbase/namespace/51884e1d2b0369b46d228cfb948034dc 2023-07-15 21:10:55,775 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/hbase/namespace/51884e1d2b0369b46d228cfb948034dc 2023-07-15 21:10:55,779 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 51884e1d2b0369b46d228cfb948034dc 2023-07-15 21:10:55,784 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/hbase/namespace/51884e1d2b0369b46d228cfb948034dc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 21:10:55,786 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 51884e1d2b0369b46d228cfb948034dc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74061488, jitterRate=0.10360217094421387}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 21:10:55,787 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 51884e1d2b0369b46d228cfb948034dc: 2023-07-15 21:10:55,795 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689455454790.51884e1d2b0369b46d228cfb948034dc., pid=6, masterSystemTime=1689455455742 2023-07-15 21:10:55,799 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689455454790.51884e1d2b0369b46d228cfb948034dc. 2023-07-15 21:10:55,799 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689455454790.51884e1d2b0369b46d228cfb948034dc. 2023-07-15 21:10:55,802 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=51884e1d2b0369b46d228cfb948034dc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:10:55,802 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689455454790.51884e1d2b0369b46d228cfb948034dc.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689455455801"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689455455801"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689455455801"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689455455801"}]},"ts":"1689455455801"} 2023-07-15 21:10:55,815 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-15 21:10:55,815 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 51884e1d2b0369b46d228cfb948034dc, server=jenkins-hbase4.apache.org,38601,1689455451863 in 219 msec 2023-07-15 21:10:55,819 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-15 21:10:55,820 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=51884e1d2b0369b46d228cfb948034dc, ASSIGN in 395 msec 2023-07-15 21:10:55,823 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 21:10:55,824 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689455455823"}]},"ts":"1689455455823"} 2023-07-15 21:10:55,826 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-15 21:10:55,831 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 21:10:55,834 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 1.0220 sec 2023-07-15 21:10:55,834 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-15 21:10:55,835 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-15 21:10:55,836 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 21:10:55,872 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-15 21:10:55,889 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-15 21:10:55,895 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 31 msec 2023-07-15 21:10:55,906 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-15 21:10:55,918 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-15 21:10:55,923 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 16 msec 2023-07-15 21:10:55,931 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-15 21:10:55,934 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-15 21:10:55,935 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.938sec 2023-07-15 21:10:55,938 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-15 21:10:55,940 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-15 21:10:55,940 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-15 21:10:55,941 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44929,1689455450325-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-15 21:10:55,942 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44929,1689455450325-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-15 21:10:55,963 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-15 21:10:55,965 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-15 21:10:55,968 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 21:10:55,969 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 21:10:55,972 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/hbase/acl/05c4da87d576dbade0070ea869b96124 2023-07-15 21:10:55,973 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/hbase/acl/05c4da87d576dbade0070ea869b96124 empty. 2023-07-15 21:10:55,975 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/hbase/acl/05c4da87d576dbade0070ea869b96124 2023-07-15 21:10:55,975 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-15 21:10:55,978 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-15 21:10:55,981 DEBUG [Listener at localhost/33869] zookeeper.ReadOnlyZKClient(139): Connect 0x49f3c037 to 127.0.0.1:57175 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 21:10:55,984 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-15 21:10:55,991 DEBUG [Listener at localhost/33869] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@34d8312b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 21:10:56,014 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-15 21:10:56,014 DEBUG [hconnection-0x2e7d2e67-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:10:56,020 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 05c4da87d576dbade0070ea869b96124, NAME => 'hbase:acl,,1689455455958.05c4da87d576dbade0070ea869b96124.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp 2023-07-15 21:10:56,029 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50396, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:10:56,036 INFO [Listener at localhost/33869] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,44929,1689455450325 2023-07-15 21:10:56,036 INFO [Listener at localhost/33869] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-15 21:10:56,036 INFO [Listener at localhost/33869] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/test.cache.data in system properties and HBase conf 2023-07-15 21:10:56,037 INFO [Listener at localhost/33869] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/hadoop.tmp.dir in system properties and HBase conf 2023-07-15 21:10:56,037 INFO [Listener at localhost/33869] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/hadoop.log.dir in system properties and HBase conf 2023-07-15 21:10:56,037 INFO [Listener at localhost/33869] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-15 21:10:56,037 INFO [Listener at localhost/33869] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-15 21:10:56,037 INFO [Listener at localhost/33869] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-15 21:10:56,037 INFO [Listener at localhost/33869] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-15 21:10:56,037 INFO [Listener at localhost/33869] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-15 21:10:56,037 INFO [Listener at localhost/33869] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-15 21:10:56,037 INFO [Listener at localhost/33869] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-15 21:10:56,037 INFO [Listener at localhost/33869] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-15 21:10:56,038 INFO [Listener at localhost/33869] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-15 21:10:56,038 INFO [Listener at localhost/33869] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-15 21:10:56,038 INFO [Listener at localhost/33869] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-15 21:10:56,038 INFO [Listener at localhost/33869] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-15 21:10:56,038 INFO [Listener at localhost/33869] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/nfs.dump.dir in system properties and HBase conf 2023-07-15 21:10:56,038 INFO [Listener at localhost/33869] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/java.io.tmpdir in system properties and HBase conf 2023-07-15 21:10:56,038 INFO [Listener at localhost/33869] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-15 21:10:56,039 INFO [Listener at localhost/33869] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-15 21:10:56,039 INFO [Listener at localhost/33869] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-15 21:10:56,059 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689455455958.05c4da87d576dbade0070ea869b96124.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:10:56,059 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 05c4da87d576dbade0070ea869b96124, disabling compactions & flushes 2023-07-15 21:10:56,059 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689455455958.05c4da87d576dbade0070ea869b96124. 2023-07-15 21:10:56,059 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689455455958.05c4da87d576dbade0070ea869b96124. 2023-07-15 21:10:56,059 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689455455958.05c4da87d576dbade0070ea869b96124. after waiting 0 ms 2023-07-15 21:10:56,059 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689455455958.05c4da87d576dbade0070ea869b96124. 2023-07-15 21:10:56,059 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689455455958.05c4da87d576dbade0070ea869b96124. 2023-07-15 21:10:56,059 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 05c4da87d576dbade0070ea869b96124: 2023-07-15 21:10:56,065 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 21:10:56,066 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689455455958.05c4da87d576dbade0070ea869b96124.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689455456066"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689455456066"}]},"ts":"1689455456066"} 2023-07-15 21:10:56,071 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-15 21:10:56,072 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 21:10:56,073 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689455456073"}]},"ts":"1689455456073"} 2023-07-15 21:10:56,076 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-15 21:10:56,084 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 21:10:56,086 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 21:10:56,086 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 21:10:56,086 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 21:10:56,086 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 21:10:56,086 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=05c4da87d576dbade0070ea869b96124, ASSIGN}] 2023-07-15 21:10:56,090 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-15 21:10:56,103 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=05c4da87d576dbade0070ea869b96124, ASSIGN 2023-07-15 21:10:56,106 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=05c4da87d576dbade0070ea869b96124, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35469,1689455451912; forceNewPlan=false, retain=false 2023-07-15 21:10:56,256 INFO [jenkins-hbase4:44929] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-15 21:10:56,257 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=05c4da87d576dbade0070ea869b96124, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:10:56,258 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689455455958.05c4da87d576dbade0070ea869b96124.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689455456257"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689455456257"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689455456257"}]},"ts":"1689455456257"} 2023-07-15 21:10:56,261 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 05c4da87d576dbade0070ea869b96124, server=jenkins-hbase4.apache.org,35469,1689455451912}] 2023-07-15 21:10:56,291 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-15 21:10:56,417 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:10:56,417 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-15 21:10:56,423 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39796, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-15 21:10:56,437 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689455455958.05c4da87d576dbade0070ea869b96124. 2023-07-15 21:10:56,437 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 05c4da87d576dbade0070ea869b96124, NAME => 'hbase:acl,,1689455455958.05c4da87d576dbade0070ea869b96124.', STARTKEY => '', ENDKEY => ''} 2023-07-15 21:10:56,438 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689455455958.05c4da87d576dbade0070ea869b96124. service=AccessControlService 2023-07-15 21:10:56,438 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 21:10:56,438 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 05c4da87d576dbade0070ea869b96124 2023-07-15 21:10:56,438 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689455455958.05c4da87d576dbade0070ea869b96124.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:10:56,439 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 05c4da87d576dbade0070ea869b96124 2023-07-15 21:10:56,439 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 05c4da87d576dbade0070ea869b96124 2023-07-15 21:10:56,441 INFO [StoreOpener-05c4da87d576dbade0070ea869b96124-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 05c4da87d576dbade0070ea869b96124 2023-07-15 21:10:56,445 DEBUG [StoreOpener-05c4da87d576dbade0070ea869b96124-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/hbase/acl/05c4da87d576dbade0070ea869b96124/l 2023-07-15 21:10:56,445 DEBUG [StoreOpener-05c4da87d576dbade0070ea869b96124-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/hbase/acl/05c4da87d576dbade0070ea869b96124/l 2023-07-15 21:10:56,446 INFO [StoreOpener-05c4da87d576dbade0070ea869b96124-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 05c4da87d576dbade0070ea869b96124 columnFamilyName l 2023-07-15 21:10:56,446 INFO [StoreOpener-05c4da87d576dbade0070ea869b96124-1] regionserver.HStore(310): Store=05c4da87d576dbade0070ea869b96124/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 21:10:56,450 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/hbase/acl/05c4da87d576dbade0070ea869b96124 2023-07-15 21:10:56,452 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/hbase/acl/05c4da87d576dbade0070ea869b96124 2023-07-15 21:10:56,457 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 05c4da87d576dbade0070ea869b96124 2023-07-15 21:10:56,464 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/hbase/acl/05c4da87d576dbade0070ea869b96124/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 21:10:56,465 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 05c4da87d576dbade0070ea869b96124; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59231010, jitterRate=-0.11738917231559753}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 21:10:56,466 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 05c4da87d576dbade0070ea869b96124: 2023-07-15 21:10:56,467 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689455455958.05c4da87d576dbade0070ea869b96124., pid=11, masterSystemTime=1689455456417 2023-07-15 21:10:56,472 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689455455958.05c4da87d576dbade0070ea869b96124. 2023-07-15 21:10:56,473 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689455455958.05c4da87d576dbade0070ea869b96124. 2023-07-15 21:10:56,474 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=05c4da87d576dbade0070ea869b96124, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:10:56,474 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689455455958.05c4da87d576dbade0070ea869b96124.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689455456474"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689455456474"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689455456474"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689455456474"}]},"ts":"1689455456474"} 2023-07-15 21:10:56,483 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-15 21:10:56,484 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 05c4da87d576dbade0070ea869b96124, server=jenkins-hbase4.apache.org,35469,1689455451912 in 217 msec 2023-07-15 21:10:56,487 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-15 21:10:56,487 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=05c4da87d576dbade0070ea869b96124, ASSIGN in 398 msec 2023-07-15 21:10:56,489 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 21:10:56,489 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689455456489"}]},"ts":"1689455456489"} 2023-07-15 21:10:56,492 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-15 21:10:56,496 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 21:10:56,501 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 533 msec 2023-07-15 21:10:56,591 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-15 21:10:56,591 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-15 21:10:56,604 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-15 21:10:57,375 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 21:10:57,687 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 21:10:57,694 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_33997_jobhistory____xqzgyo/webapp 2023-07-15 21:10:57,850 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-15 21:10:57,850 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-15 21:10:57,850 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-15 21:10:57,853 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-15 21:10:57,925 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 21:10:58,244 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 21:10:58,609 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-15 21:10:58,644 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:33997 2023-07-15 21:10:58,867 WARN [Listener at jenkins-hbase4.apache.org/40745] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 21:10:59,301 WARN [Listener at jenkins-hbase4.apache.org/40745] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-15 21:10:59,302 INFO [Listener at jenkins-hbase4.apache.org/40745] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 21:10:59,329 INFO [Listener at jenkins-hbase4.apache.org/40745] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_42425_cluster____.frm2id/webapp 2023-07-15 21:10:59,454 INFO [Listener at jenkins-hbase4.apache.org/40745] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-15 21:10:59,454 INFO [Listener at jenkins-hbase4.apache.org/40745] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-15 21:10:59,454 INFO [Listener at jenkins-hbase4.apache.org/40745] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-15 21:10:59,455 INFO [Listener at jenkins-hbase4.apache.org/40745] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-15 21:10:59,472 INFO [Listener at jenkins-hbase4.apache.org/40745] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 21:10:59,808 INFO [Listener at jenkins-hbase4.apache.org/40745] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 21:10:59,943 INFO [Listener at jenkins-hbase4.apache.org/40745] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 21:10:59,953 INFO [Listener at jenkins-hbase4.apache.org/40745] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:42425 2023-07-15 21:11:00,099 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-15 21:11:00,340 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-15 21:11:00,341 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-15 21:11:00,342 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-15 21:11:00,502 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 21:11:00,503 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-15 21:11:00,504 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 21:11:00,504 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-15 21:11:00,504 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-15 21:11:00,504 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-15 21:11:00,504 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 21:11:00,504 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-15 21:11:00,505 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-15 21:11:00,505 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-15 21:11:00,774 WARN [Listener at jenkins-hbase4.apache.org/33487] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 21:11:00,800 WARN [Listener at jenkins-hbase4.apache.org/33487] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-15 21:11:00,801 INFO [Listener at jenkins-hbase4.apache.org/33487] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 21:11:00,809 INFO [Listener at jenkins-hbase4.apache.org/33487] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_38879_node____.yk7nl9/webapp 2023-07-15 21:11:00,865 INFO [Listener at jenkins-hbase4.apache.org/33487] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-15 21:11:00,865 INFO [Listener at jenkins-hbase4.apache.org/33487] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-15 21:11:00,865 INFO [Listener at jenkins-hbase4.apache.org/33487] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-15 21:11:00,865 INFO [Listener at jenkins-hbase4.apache.org/33487] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-15 21:11:00,874 INFO [Listener at jenkins-hbase4.apache.org/33487] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 21:11:00,898 INFO [Listener at jenkins-hbase4.apache.org/33487] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 21:11:00,988 INFO [Listener at jenkins-hbase4.apache.org/33487] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 21:11:01,019 INFO [Listener at jenkins-hbase4.apache.org/33487] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:38879 2023-07-15 21:11:01,240 WARN [Listener at jenkins-hbase4.apache.org/44607] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 21:11:01,248 WARN [Listener at jenkins-hbase4.apache.org/44607] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-15 21:11:01,249 INFO [Listener at jenkins-hbase4.apache.org/44607] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 21:11:01,257 INFO [Listener at jenkins-hbase4.apache.org/44607] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_37323_node____ndfx1q/webapp 2023-07-15 21:11:01,311 INFO [Listener at jenkins-hbase4.apache.org/44607] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-15 21:11:01,311 INFO [Listener at jenkins-hbase4.apache.org/44607] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-15 21:11:01,311 INFO [Listener at jenkins-hbase4.apache.org/44607] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-15 21:11:01,311 INFO [Listener at jenkins-hbase4.apache.org/44607] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-15 21:11:01,320 INFO [Listener at jenkins-hbase4.apache.org/44607] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 21:11:01,334 INFO [Listener at jenkins-hbase4.apache.org/44607] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 21:11:01,402 INFO [Listener at jenkins-hbase4.apache.org/44607] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 21:11:01,407 INFO [Listener at jenkins-hbase4.apache.org/44607] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:37323 2023-07-15 21:11:01,430 INFO [Listener at jenkins-hbase4.apache.org/44607] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-15 21:11:01,432 INFO [Listener at jenkins-hbase4.apache.org/44607] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 21:11:01,493 INFO [Listener at jenkins-hbase4.apache.org/44607] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=709, OpenFileDescriptor=896, MaxFileDescriptor=60000, SystemLoadAverage=293, ProcessCount=174, AvailableMemoryMB=4837 2023-07-15 21:11:01,493 WARN [Listener at jenkins-hbase4.apache.org/44607] hbase.ResourceChecker(130): Thread=709 is superior to 500 2023-07-15 21:11:01,505 DEBUG [Listener at jenkins-hbase4.apache.org/44607] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-15 21:11:01,512 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36580, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-15 21:11:01,519 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-15 21:11:01,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-15 21:11:01,524 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 21:11:01,524 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-15 21:11:01,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-15 21:11:01,527 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 21:11:01,531 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportWithTargetName/48713c654fcc87d50df7ae0bd9b18f06 2023-07-15 21:11:01,531 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportWithTargetName/f23d7f07de3cbd08ce081e2353fab47a 2023-07-15 21:11:01,533 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportWithTargetName/48713c654fcc87d50df7ae0bd9b18f06 empty. 2023-07-15 21:11:01,533 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportWithTargetName/f23d7f07de3cbd08ce081e2353fab47a empty. 2023-07-15 21:11:01,534 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportWithTargetName/48713c654fcc87d50df7ae0bd9b18f06 2023-07-15 21:11:01,534 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportWithTargetName/f23d7f07de3cbd08ce081e2353fab47a 2023-07-15 21:11:01,534 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-15 21:11:01,564 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-15 21:11:01,565 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 48713c654fcc87d50df7ae0bd9b18f06, NAME => 'testtb-testExportWithTargetName,,1689455461519.48713c654fcc87d50df7ae0bd9b18f06.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp 2023-07-15 21:11:01,565 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => f23d7f07de3cbd08ce081e2353fab47a, NAME => 'testtb-testExportWithTargetName,1,1689455461519.f23d7f07de3cbd08ce081e2353fab47a.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp 2023-07-15 21:11:01,598 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689455461519.f23d7f07de3cbd08ce081e2353fab47a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:11:01,598 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing f23d7f07de3cbd08ce081e2353fab47a, disabling compactions & flushes 2023-07-15 21:11:01,598 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689455461519.f23d7f07de3cbd08ce081e2353fab47a. 2023-07-15 21:11:01,598 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689455461519.f23d7f07de3cbd08ce081e2353fab47a. 2023-07-15 21:11:01,598 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689455461519.f23d7f07de3cbd08ce081e2353fab47a. after waiting 0 ms 2023-07-15 21:11:01,598 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689455461519.f23d7f07de3cbd08ce081e2353fab47a. 2023-07-15 21:11:01,598 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689455461519.f23d7f07de3cbd08ce081e2353fab47a. 2023-07-15 21:11:01,598 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for f23d7f07de3cbd08ce081e2353fab47a: 2023-07-15 21:11:01,599 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689455461519.48713c654fcc87d50df7ae0bd9b18f06.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:11:01,600 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 48713c654fcc87d50df7ae0bd9b18f06, disabling compactions & flushes 2023-07-15 21:11:01,600 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689455461519.48713c654fcc87d50df7ae0bd9b18f06. 2023-07-15 21:11:01,600 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689455461519.48713c654fcc87d50df7ae0bd9b18f06. 2023-07-15 21:11:01,600 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689455461519.48713c654fcc87d50df7ae0bd9b18f06. after waiting 0 ms 2023-07-15 21:11:01,600 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689455461519.48713c654fcc87d50df7ae0bd9b18f06. 2023-07-15 21:11:01,600 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689455461519.48713c654fcc87d50df7ae0bd9b18f06. 2023-07-15 21:11:01,600 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 48713c654fcc87d50df7ae0bd9b18f06: 2023-07-15 21:11:01,604 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 21:11:01,606 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689455461519.f23d7f07de3cbd08ce081e2353fab47a.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689455461605"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689455461605"}]},"ts":"1689455461605"} 2023-07-15 21:11:01,606 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689455461519.48713c654fcc87d50df7ae0bd9b18f06.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689455461605"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689455461605"}]},"ts":"1689455461605"} 2023-07-15 21:11:01,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-15 21:11:01,661 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-15 21:11:01,663 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 21:11:01,663 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689455461663"}]},"ts":"1689455461663"} 2023-07-15 21:11:01,666 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-15 21:11:01,672 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 21:11:01,674 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 21:11:01,674 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 21:11:01,674 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 21:11:01,674 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 21:11:01,675 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=48713c654fcc87d50df7ae0bd9b18f06, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f23d7f07de3cbd08ce081e2353fab47a, ASSIGN}] 2023-07-15 21:11:01,679 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f23d7f07de3cbd08ce081e2353fab47a, ASSIGN 2023-07-15 21:11:01,679 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=48713c654fcc87d50df7ae0bd9b18f06, ASSIGN 2023-07-15 21:11:01,682 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=48713c654fcc87d50df7ae0bd9b18f06, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44797,1689455451778; forceNewPlan=false, retain=false 2023-07-15 21:11:01,682 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f23d7f07de3cbd08ce081e2353fab47a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38601,1689455451863; forceNewPlan=false, retain=false 2023-07-15 21:11:01,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-15 21:11:01,833 INFO [jenkins-hbase4:44929] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-15 21:11:01,836 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=48713c654fcc87d50df7ae0bd9b18f06, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:01,836 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=f23d7f07de3cbd08ce081e2353fab47a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:01,836 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689455461519.48713c654fcc87d50df7ae0bd9b18f06.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689455461836"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689455461836"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689455461836"}]},"ts":"1689455461836"} 2023-07-15 21:11:01,836 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689455461519.f23d7f07de3cbd08ce081e2353fab47a.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689455461836"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689455461836"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689455461836"}]},"ts":"1689455461836"} 2023-07-15 21:11:01,839 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure 48713c654fcc87d50df7ae0bd9b18f06, server=jenkins-hbase4.apache.org,44797,1689455451778}] 2023-07-15 21:11:01,841 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure f23d7f07de3cbd08ce081e2353fab47a, server=jenkins-hbase4.apache.org,38601,1689455451863}] 2023-07-15 21:11:01,993 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:01,993 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-15 21:11:01,997 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50058, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-15 21:11:02,002 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689455461519.48713c654fcc87d50df7ae0bd9b18f06. 2023-07-15 21:11:02,003 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689455461519.f23d7f07de3cbd08ce081e2353fab47a. 2023-07-15 21:11:02,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 48713c654fcc87d50df7ae0bd9b18f06, NAME => 'testtb-testExportWithTargetName,,1689455461519.48713c654fcc87d50df7ae0bd9b18f06.', STARTKEY => '', ENDKEY => '1'} 2023-07-15 21:11:02,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f23d7f07de3cbd08ce081e2353fab47a, NAME => 'testtb-testExportWithTargetName,1,1689455461519.f23d7f07de3cbd08ce081e2353fab47a.', STARTKEY => '1', ENDKEY => ''} 2023-07-15 21:11:02,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689455461519.f23d7f07de3cbd08ce081e2353fab47a. service=AccessControlService 2023-07-15 21:11:02,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689455461519.48713c654fcc87d50df7ae0bd9b18f06. service=AccessControlService 2023-07-15 21:11:02,003 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 21:11:02,003 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 21:11:02,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName f23d7f07de3cbd08ce081e2353fab47a 2023-07-15 21:11:02,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689455461519.f23d7f07de3cbd08ce081e2353fab47a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:11:02,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 48713c654fcc87d50df7ae0bd9b18f06 2023-07-15 21:11:02,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f23d7f07de3cbd08ce081e2353fab47a 2023-07-15 21:11:02,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689455461519.48713c654fcc87d50df7ae0bd9b18f06.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:11:02,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f23d7f07de3cbd08ce081e2353fab47a 2023-07-15 21:11:02,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 48713c654fcc87d50df7ae0bd9b18f06 2023-07-15 21:11:02,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 48713c654fcc87d50df7ae0bd9b18f06 2023-07-15 21:11:02,006 INFO [StoreOpener-48713c654fcc87d50df7ae0bd9b18f06-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 48713c654fcc87d50df7ae0bd9b18f06 2023-07-15 21:11:02,006 INFO [StoreOpener-f23d7f07de3cbd08ce081e2353fab47a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f23d7f07de3cbd08ce081e2353fab47a 2023-07-15 21:11:02,008 DEBUG [StoreOpener-48713c654fcc87d50df7ae0bd9b18f06-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportWithTargetName/48713c654fcc87d50df7ae0bd9b18f06/cf 2023-07-15 21:11:02,008 DEBUG [StoreOpener-48713c654fcc87d50df7ae0bd9b18f06-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportWithTargetName/48713c654fcc87d50df7ae0bd9b18f06/cf 2023-07-15 21:11:02,008 DEBUG [StoreOpener-f23d7f07de3cbd08ce081e2353fab47a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportWithTargetName/f23d7f07de3cbd08ce081e2353fab47a/cf 2023-07-15 21:11:02,009 DEBUG [StoreOpener-f23d7f07de3cbd08ce081e2353fab47a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportWithTargetName/f23d7f07de3cbd08ce081e2353fab47a/cf 2023-07-15 21:11:02,009 INFO [StoreOpener-48713c654fcc87d50df7ae0bd9b18f06-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 48713c654fcc87d50df7ae0bd9b18f06 columnFamilyName cf 2023-07-15 21:11:02,009 INFO [StoreOpener-f23d7f07de3cbd08ce081e2353fab47a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f23d7f07de3cbd08ce081e2353fab47a columnFamilyName cf 2023-07-15 21:11:02,010 INFO [StoreOpener-f23d7f07de3cbd08ce081e2353fab47a-1] regionserver.HStore(310): Store=f23d7f07de3cbd08ce081e2353fab47a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 21:11:02,011 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportWithTargetName/f23d7f07de3cbd08ce081e2353fab47a 2023-07-15 21:11:02,012 INFO [StoreOpener-48713c654fcc87d50df7ae0bd9b18f06-1] regionserver.HStore(310): Store=48713c654fcc87d50df7ae0bd9b18f06/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 21:11:02,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportWithTargetName/f23d7f07de3cbd08ce081e2353fab47a 2023-07-15 21:11:02,013 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportWithTargetName/48713c654fcc87d50df7ae0bd9b18f06 2023-07-15 21:11:02,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportWithTargetName/48713c654fcc87d50df7ae0bd9b18f06 2023-07-15 21:11:02,017 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f23d7f07de3cbd08ce081e2353fab47a 2023-07-15 21:11:02,020 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 48713c654fcc87d50df7ae0bd9b18f06 2023-07-15 21:11:02,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportWithTargetName/f23d7f07de3cbd08ce081e2353fab47a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 21:11:02,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportWithTargetName/48713c654fcc87d50df7ae0bd9b18f06/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 21:11:02,031 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 48713c654fcc87d50df7ae0bd9b18f06; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69153045, jitterRate=0.030460670590400696}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 21:11:02,031 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f23d7f07de3cbd08ce081e2353fab47a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68797308, jitterRate=0.025159776210784912}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 21:11:02,031 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 48713c654fcc87d50df7ae0bd9b18f06: 2023-07-15 21:11:02,031 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f23d7f07de3cbd08ce081e2353fab47a: 2023-07-15 21:11:02,033 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689455461519.48713c654fcc87d50df7ae0bd9b18f06., pid=15, masterSystemTime=1689455461993 2023-07-15 21:11:02,033 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689455461519.f23d7f07de3cbd08ce081e2353fab47a., pid=16, masterSystemTime=1689455461993 2023-07-15 21:11:02,037 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689455461519.48713c654fcc87d50df7ae0bd9b18f06. 2023-07-15 21:11:02,038 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689455461519.48713c654fcc87d50df7ae0bd9b18f06. 2023-07-15 21:11:02,039 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=48713c654fcc87d50df7ae0bd9b18f06, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:02,040 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689455461519.f23d7f07de3cbd08ce081e2353fab47a. 2023-07-15 21:11:02,040 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689455461519.f23d7f07de3cbd08ce081e2353fab47a. 2023-07-15 21:11:02,040 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689455461519.48713c654fcc87d50df7ae0bd9b18f06.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689455462039"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689455462039"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689455462039"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689455462039"}]},"ts":"1689455462039"} 2023-07-15 21:11:02,041 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=f23d7f07de3cbd08ce081e2353fab47a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:02,041 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689455461519.f23d7f07de3cbd08ce081e2353fab47a.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689455462041"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689455462041"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689455462041"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689455462041"}]},"ts":"1689455462041"} 2023-07-15 21:11:02,047 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=13 2023-07-15 21:11:02,048 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure 48713c654fcc87d50df7ae0bd9b18f06, server=jenkins-hbase4.apache.org,44797,1689455451778 in 204 msec 2023-07-15 21:11:02,049 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=14 2023-07-15 21:11:02,050 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure f23d7f07de3cbd08ce081e2353fab47a, server=jenkins-hbase4.apache.org,38601,1689455451863 in 204 msec 2023-07-15 21:11:02,052 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=48713c654fcc87d50df7ae0bd9b18f06, ASSIGN in 373 msec 2023-07-15 21:11:02,053 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=12 2023-07-15 21:11:02,053 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f23d7f07de3cbd08ce081e2353fab47a, ASSIGN in 375 msec 2023-07-15 21:11:02,054 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 21:11:02,054 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689455462054"}]},"ts":"1689455462054"} 2023-07-15 21:11:02,056 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-15 21:11:02,060 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 21:11:02,065 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-15 21:11:02,071 DEBUG [PEWorker-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:11:02,074 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33120, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:11:02,078 DEBUG [hconnection-0x25bc5d6c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:11:02,081 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45626, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=ClientService 2023-07-15 21:11:02,090 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35469] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-15 21:11:02,119 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-15 21:11:02,119 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-15 21:11:02,119 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-15 21:11:02,119 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 21:11:02,119 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-15 21:11:02,127 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 21:11:02,128 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-15 21:11:02,128 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-15 21:11:02,128 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-15 21:11:02,128 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-15 21:11:02,131 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 609 msec 2023-07-15 21:11:02,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-15 21:11:02,133 INFO [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-15 21:11:02,133 DEBUG [Listener at jenkins-hbase4.apache.org/44607] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportWithTargetName get assigned. Timeout = 60000ms 2023-07-15 21:11:02,134 INFO [Listener at jenkins-hbase4.apache.org/44607] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 21:11:02,139 INFO [Listener at jenkins-hbase4.apache.org/44607] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportWithTargetName assigned to meta. Checking AM states. 2023-07-15 21:11:02,140 INFO [Listener at jenkins-hbase4.apache.org/44607] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 21:11:02,140 INFO [Listener at jenkins-hbase4.apache.org/44607] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportWithTargetName assigned. 2023-07-15 21:11:02,154 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-15 21:11:02,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689455462154 (current time:1689455462154). 2023-07-15 21:11:02,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 21:11:02,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] zookeeper.ReadOnlyZKClient(139): Connect 0x7c601aec to 127.0.0.1:57175 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 21:11:02,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1681351d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 21:11:02,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:11:02,164 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45634, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:11:02,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7c601aec to 127.0.0.1:57175 2023-07-15 21:11:02,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 21:11:02,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] zookeeper.ReadOnlyZKClient(139): Connect 0x438dd540 to 127.0.0.1:57175 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 21:11:02,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3da1d4a6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 21:11:02,174 DEBUG [hconnection-0x6b0e8acf-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:11:02,175 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45648, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:11:02,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:11:02,180 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33128, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:11:02,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x438dd540 to 127.0.0.1:57175 2023-07-15 21:11:02,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 21:11:02,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-15 21:11:02,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 21:11:02,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-15 21:11:02,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-15 21:11:02,227 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-15 21:11:02,228 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689456062228 2023-07-15 21:11:02,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-15 21:11:02,228 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-15 21:11:02,231 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-15 21:11:02,232 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-15 21:11:02,233 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 12 msec 2023-07-15 21:11:02,234 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-15 21:11:02,235 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689456062235 2023-07-15 21:11:02,236 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 21:11:02,236 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 21:11:02,261 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,261 INFO [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-15 21:11:02,261 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:11:02,262 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-15 21:11:02,262 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-15 21:11:02,263 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,263 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,268 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:11:02,268 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:11:02,268 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:02,268 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:11:02,268 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:11:02,268 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:11:02,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:11:02,268 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:11:02,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:11:02,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:11:02,269 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:02,270 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:02,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,270 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:02,270 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 21:11:02,270 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,270 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,270 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-15 21:11:02,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-15 21:11:02,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,271 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-15 21:11:02,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-15 21:11:02,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,271 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-15 21:11:02,272 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-15 21:11:02,274 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,274 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,274 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,274 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-15 21:11:02,274 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-15 21:11:02,275 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-15 21:11:02,274 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:11:02,275 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:11:02,276 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-15 21:11:02,276 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-15 21:11:02,276 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-15 21:11:02,275 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:11:02,276 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35469,1689455451912' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-15 21:11:02,277 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-15 21:11:02,277 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-15 21:11:02,276 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-15 21:11:02,277 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44797,1689455451778' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-15 21:11:02,277 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38601,1689455451863' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-15 21:11:02,279 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,281 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:02,281 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,281 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:02,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:02,281 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,281 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:11:02,281 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:11:02,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:11:02,282 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,282 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:11:02,282 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:11:02,282 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:11:02,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:11:02,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:02,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:02,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:02,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:11:02,284 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44797,1689455451778' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-15 21:11:02,284 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5bd22ae9[Count = 1] remaining members to acquire global barrier 2023-07-15 21:11:02,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:02,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:11:02,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:11:02,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:11:02,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:11:02,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:02,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:02,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:02,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:11:02,287 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38601,1689455451863' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-15 21:11:02,287 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5bd22ae9[Count = 0] remaining members to acquire global barrier 2023-07-15 21:11:02,287 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-15 21:11:02,287 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,290 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,290 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,290 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,290 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-15 21:11:02,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,290 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-15 21:11:02,290 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-15 21:11:02,290 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:02,290 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-15 21:11:02,290 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,35469,1689455451912' in zk 2023-07-15 21:11:02,291 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:02,291 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 21:11:02,291 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 21:11:02,291 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 21:11:02,291 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689455461519.48713c654fcc87d50df7ae0bd9b18f06. 2023-07-15 21:11:02,291 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 21:11:02,291 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 21:11:02,291 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689455461519.f23d7f07de3cbd08ce081e2353fab47a. 2023-07-15 21:11:02,293 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689455461519.f23d7f07de3cbd08ce081e2353fab47a. started... 2023-07-15 21:11:02,293 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689455461519.48713c654fcc87d50df7ae0bd9b18f06. started... 2023-07-15 21:11:02,293 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-15 21:11:02,293 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:11:02,293 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-15 21:11:02,297 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 48713c654fcc87d50df7ae0bd9b18f06: 2023-07-15 21:11:02,297 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f23d7f07de3cbd08ce081e2353fab47a: 2023-07-15 21:11:02,298 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689455461519.f23d7f07de3cbd08ce081e2353fab47a.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,298 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689455461519.48713c654fcc87d50df7ae0bd9b18f06.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,305 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 21:11:02,305 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 21:11:02,309 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 21:11:02,309 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 21:11:02,337 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 21:11:02,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-15 21:11:02,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-15 21:11:02,353 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 21:11:02,354 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689455461519.48713c654fcc87d50df7ae0bd9b18f06. completed. 2023-07-15 21:11:02,355 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689455461519.48713c654fcc87d50df7ae0bd9b18f06. 2023-07-15 21:11:02,355 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 21:11:02,355 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 21:11:02,355 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:02,355 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-15 21:11:02,355 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,44797,1689455451778' in zk 2023-07-15 21:11:02,357 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:02,357 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-15 21:11:02,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:02,357 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:11:02,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:11:02,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:11:02,358 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-15 21:11:02,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:11:02,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:11:02,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:02,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:02,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:02,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:11:02,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:02,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:02,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,44797,1689455451778': 2023-07-15 21:11:02,365 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44797,1689455451778' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-15 21:11:02,553 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 21:11:02,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-15 21:11:02,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-15 21:11:02,555 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-15 21:11:02,756 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689455461519.f23d7f07de3cbd08ce081e2353fab47a. completed. 2023-07-15 21:11:02,756 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689455461519.f23d7f07de3cbd08ce081e2353fab47a. 2023-07-15 21:11:02,756 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 21:11:02,756 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 21:11:02,756 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:02,756 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-15 21:11:02,756 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,38601,1689455451863' in zk 2023-07-15 21:11:02,758 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-15 21:11:02,758 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:02,758 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:11:02,758 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-15 21:11:02,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:02,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:11:02,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:11:02,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:11:02,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:11:02,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:02,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:02,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:02,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:11:02,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:02,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:02,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:02,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,38601,1689455451863': 2023-07-15 21:11:02,764 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38601,1689455451863' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-15 21:11:02,764 INFO [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-15 21:11:02,764 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 21:11:02,764 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 21:11:02,764 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,764 INFO [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 21:11:02,767 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,767 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,767 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,767 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:11:02,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:11:02,767 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:11:02,767 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,767 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:11:02,767 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,768 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:11:02,768 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:02,768 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:11:02,768 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:11:02,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:11:02,768 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:11:02,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:11:02,768 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:11:02,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:11:02,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,769 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:02,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:11:02,769 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:02,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:02,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:02,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:02,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:11:02,771 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:02,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,772 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:02,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:02,772 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:02,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:02,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:02,786 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:11:02,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:11:02,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:11:02,786 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:11:02,787 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:11:02,787 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:11:02,787 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:02,787 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,787 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:02,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:11:02,787 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:02,787 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:11:02,787 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:11:02,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:11:02,787 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:11:02,787 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:11:02,787 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:02,787 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:11:02,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:11:02,787 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:11:02,787 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,788 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:11:02,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:11:02,788 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:02,788 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:11:02,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:11:02,788 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:02,788 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,788 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,791 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,833 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,859 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 21:11:02,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-15 21:11:02,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-15 21:11:02,862 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-15 21:11:02,892 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-15 21:11:02,893 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,893 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,893 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689455462229Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689455462787 (+558 ms)Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689455462788 (+1 ms)Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689455462802 (+14 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689455462820 (+18 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689455462892 (+72 ms) 2023-07-15 21:11:02,895 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-15 21:11:02,898 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 666 msec 2023-07-15 21:11:03,363 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 21:11:03,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-15 21:11:03,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 21:11:03,387 DEBUG [htable-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:11:03,392 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50074, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:11:03,393 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44797] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689455461519.48713c654fcc87d50df7ae0bd9b18f06. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 21:11:03,393 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38601] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689455461519.f23d7f07de3cbd08ce081e2353fab47a. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 21:11:03,399 DEBUG [Listener at jenkins-hbase4.apache.org/44607] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-15 21:11:03,400 DEBUG [Listener at jenkins-hbase4.apache.org/44607] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689455461519.48713c654fcc87d50df7ae0bd9b18f06. 2023-07-15 21:11:03,403 INFO [Listener at jenkins-hbase4.apache.org/44607] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 21:11:03,435 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-15 21:11:03,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689455463436 (current time:1689455463436). 2023-07-15 21:11:03,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 21:11:03,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] zookeeper.ReadOnlyZKClient(139): Connect 0x047353d1 to 127.0.0.1:57175 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 21:11:03,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@65dfcf23, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 21:11:03,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:11:03,448 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45654, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:11:03,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x047353d1 to 127.0.0.1:57175 2023-07-15 21:11:03,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 21:11:03,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] zookeeper.ReadOnlyZKClient(139): Connect 0x48899475 to 127.0.0.1:57175 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 21:11:03,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@56fabb6e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 21:11:03,459 DEBUG [hconnection-0x4d47c045-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:11:03,462 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45658, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:11:03,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:11:03,470 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33140, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:11:03,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x48899475 to 127.0.0.1:57175 2023-07-15 21:11:03,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 21:11:03,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-15 21:11:03,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 21:11:03,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-15 21:11:03,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-15 21:11:03,481 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-15 21:11:03,482 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689456063482 2023-07-15 21:11:03,482 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-15 21:11:03,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-15 21:11:03,484 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 21:11:03,484 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 21:11:03,484 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-15 21:11:03,485 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-15 21:11:03,487 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 7 msec 2023-07-15 21:11:03,488 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-15 21:11:03,489 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689456063489 2023-07-15 21:11:03,507 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-15 21:11:03,507 INFO [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-15 21:11:03,507 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:11:03,509 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-15 21:11:03,509 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-15 21:11:03,580 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,580 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,582 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:03,582 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:11:03,582 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:11:03,582 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:11:03,582 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:11:03,582 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:11:03,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:11:03,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:11:03,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,584 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,584 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 21:11:03,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-15 21:11:03,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,585 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-15 21:11:03,585 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-15 21:11:03,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:11:03,585 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-15 21:11:03,585 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:11:03,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:11:03,587 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:03,587 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-15 21:11:03,587 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-15 21:11:03,587 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44797,1689455451778' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-15 21:11:03,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,587 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:03,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-15 21:11:03,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-15 21:11:03,589 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,589 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 21:11:03,589 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:03,589 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 21:11:03,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-15 21:11:03,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,590 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-15 21:11:03,590 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-15 21:11:03,591 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-15 21:11:03,591 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:11:03,592 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-15 21:11:03,592 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-15 21:11:03,592 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38601,1689455451863' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-15 21:11:03,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,595 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:03,595 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:03,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:11:03,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:11:03,596 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,596 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:11:03,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:11:03,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:11:03,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 21:11:03,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:03,598 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,601 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:03,602 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:11:03,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-15 21:11:03,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,602 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-15 21:11:03,602 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,602 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:11:03,602 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38601,1689455451863' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-15 21:11:03,602 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@135a4987[Count = 1] remaining members to acquire global barrier 2023-07-15 21:11:03,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:03,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:11:03,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:11:03,603 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-15 21:11:03,604 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-15 21:11:03,604 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:11:03,606 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-15 21:11:03,606 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-15 21:11:03,606 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35469,1689455451912' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-15 21:11:03,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:11:03,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:11:03,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 21:11:03,610 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:03,611 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,611 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:11:03,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:03,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:03,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:11:03,613 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44797,1689455451778' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-15 21:11:03,613 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@135a4987[Count = 0] remaining members to acquire global barrier 2023-07-15 21:11:03,613 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-15 21:11:03,614 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,617 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,618 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,618 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,618 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,618 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-15 21:11:03,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,618 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,618 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-15 21:11:03,618 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,618 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-15 21:11:03,618 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 21:11:03,618 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 21:11:03,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,618 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,35469,1689455451912' in zk 2023-07-15 21:11:03,619 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-15 21:11:03,619 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689455461519.f23d7f07de3cbd08ce081e2353fab47a. 2023-07-15 21:11:03,619 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689455461519.f23d7f07de3cbd08ce081e2353fab47a. started... 2023-07-15 21:11:03,619 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 21:11:03,619 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 21:11:03,619 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689455461519.48713c654fcc87d50df7ae0bd9b18f06. 2023-07-15 21:11:03,619 INFO [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f23d7f07de3cbd08ce081e2353fab47a 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-07-15 21:11:03,619 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689455461519.48713c654fcc87d50df7ae0bd9b18f06. started... 2023-07-15 21:11:03,619 INFO [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 48713c654fcc87d50df7ae0bd9b18f06 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-07-15 21:11:03,622 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-15 21:11:03,622 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:11:03,622 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-15 21:11:03,622 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:03,624 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:03,624 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 21:11:03,727 INFO [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.87 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportWithTargetName/f23d7f07de3cbd08ce081e2353fab47a/.tmp/cf/8b1b0da01efa40288db086c6846765f8 2023-07-15 21:11:03,732 INFO [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=400 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportWithTargetName/48713c654fcc87d50df7ae0bd9b18f06/.tmp/cf/cc88a4ec9f2a457680b0f88a9cded054 2023-07-15 21:11:03,779 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportWithTargetName/48713c654fcc87d50df7ae0bd9b18f06/.tmp/cf/cc88a4ec9f2a457680b0f88a9cded054 as hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportWithTargetName/48713c654fcc87d50df7ae0bd9b18f06/cf/cc88a4ec9f2a457680b0f88a9cded054 2023-07-15 21:11:03,779 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportWithTargetName/f23d7f07de3cbd08ce081e2353fab47a/.tmp/cf/8b1b0da01efa40288db086c6846765f8 as hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportWithTargetName/f23d7f07de3cbd08ce081e2353fab47a/cf/8b1b0da01efa40288db086c6846765f8 2023-07-15 21:11:03,789 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 21:11:03,793 INFO [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportWithTargetName/48713c654fcc87d50df7ae0bd9b18f06/cf/cc88a4ec9f2a457680b0f88a9cded054, entries=6, sequenceid=6, filesize=5.2 K 2023-07-15 21:11:03,794 INFO [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportWithTargetName/f23d7f07de3cbd08ce081e2353fab47a/cf/8b1b0da01efa40288db086c6846765f8, entries=44, sequenceid=6, filesize=7.8 K 2023-07-15 21:11:03,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-15 21:11:03,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-15 21:11:03,797 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-15 21:11:03,798 INFO [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for 48713c654fcc87d50df7ae0bd9b18f06 in 179ms, sequenceid=6, compaction requested=false 2023-07-15 21:11:03,798 INFO [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for f23d7f07de3cbd08ce081e2353fab47a in 179ms, sequenceid=6, compaction requested=false 2023-07-15 21:11:03,798 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-15 21:11:03,798 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-15 21:11:03,801 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f23d7f07de3cbd08ce081e2353fab47a: 2023-07-15 21:11:03,801 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 48713c654fcc87d50df7ae0bd9b18f06: 2023-07-15 21:11:03,801 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689455461519.f23d7f07de3cbd08ce081e2353fab47a.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-15 21:11:03,801 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689455461519.48713c654fcc87d50df7ae0bd9b18f06.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-15 21:11:03,801 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 21:11:03,801 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 21:11:03,802 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportWithTargetName/48713c654fcc87d50df7ae0bd9b18f06/cf/cc88a4ec9f2a457680b0f88a9cded054] hfiles 2023-07-15 21:11:03,802 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportWithTargetName/f23d7f07de3cbd08ce081e2353fab47a/cf/8b1b0da01efa40288db086c6846765f8] hfiles 2023-07-15 21:11:03,802 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportWithTargetName/48713c654fcc87d50df7ae0bd9b18f06/cf/cc88a4ec9f2a457680b0f88a9cded054 for snapshot=snaptb0-testExportWithTargetName 2023-07-15 21:11:03,802 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportWithTargetName/f23d7f07de3cbd08ce081e2353fab47a/cf/8b1b0da01efa40288db086c6846765f8 for snapshot=snaptb0-testExportWithTargetName 2023-07-15 21:11:03,837 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689455461519.f23d7f07de3cbd08ce081e2353fab47a. completed. 2023-07-15 21:11:03,838 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689455461519.f23d7f07de3cbd08ce081e2353fab47a. 2023-07-15 21:11:03,838 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 21:11:03,838 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 21:11:03,838 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689455461519.48713c654fcc87d50df7ae0bd9b18f06. completed. 2023-07-15 21:11:03,838 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:03,838 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689455461519.48713c654fcc87d50df7ae0bd9b18f06. 2023-07-15 21:11:03,838 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-15 21:11:03,838 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 21:11:03,838 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,38601,1689455451863' in zk 2023-07-15 21:11:03,838 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 21:11:03,838 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:03,838 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-15 21:11:03,838 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,44797,1689455451778' in zk 2023-07-15 21:11:03,843 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:03,843 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-15 21:11:03,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:03,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:11:03,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:11:03,843 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:11:03,843 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-15 21:11:03,845 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-15 21:11:03,845 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:11:03,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:11:03,845 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:03,845 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-15 21:11:03,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:11:03,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 21:11:03,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:03,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:03,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:03,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:11:03,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 21:11:03,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:03,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:03,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:03,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,38601,1689455451863': 2023-07-15 21:11:03,849 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38601,1689455451863' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-15 21:11:03,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:03,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:11:03,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:11:03,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:11:03,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:11:03,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 21:11:03,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:03,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:03,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:03,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:11:03,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 21:11:03,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:03,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:03,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:03,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,44797,1689455451778': 2023-07-15 21:11:03,854 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44797,1689455451778' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-15 21:11:03,854 INFO [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-15 21:11:03,854 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 21:11:03,854 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 21:11:03,854 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-15 21:11:03,854 INFO [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 21:11:03,856 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,856 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:11:03,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:11:03,856 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,856 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,856 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:11:03,856 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:11:03,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,856 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:11:03,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:11:03,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:11:03,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:11:03,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:11:03,858 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:03,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:11:03,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:11:03,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 21:11:03,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:11:03,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:11:03,859 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:03,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 21:11:03,868 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:03,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:03,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:03,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:03,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:11:03,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 21:11:03,870 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:03,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:03,870 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:03,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:03,871 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:03,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:03,882 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:03,882 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,882 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:03,882 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:11:03,882 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:11:03,882 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:11:03,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:11:03,882 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:03,882 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:11:03,882 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,883 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:11:03,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:11:03,882 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:11:03,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:11:03,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:11:03,883 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-15 21:11:03,884 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-15 21:11:03,883 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:03,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:11:03,883 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:11:03,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:11:03,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:11:03,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:11:03,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:11:03,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:11:03,884 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,885 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:03,885 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:03,885 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,885 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,885 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:11:03,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:11:03,922 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,969 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-15 21:11:03,970 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,970 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,970 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689455463482Consolidate snapshot: snaptb0-testExportWithTargetName at 1689455463884 (+402 ms)Loading Region manifests for snaptb0-testExportWithTargetName at 1689455463884Writing data manifest for snaptb0-testExportWithTargetName at 1689455463890 (+6 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689455463910 (+20 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689455463969 (+59 ms) 2023-07-15 21:11:03,972 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-15 21:11:03,974 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 489 msec 2023-07-15 21:11:04,097 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 21:11:04,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-15 21:11:04,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 21:11:04,100 INFO [Listener at jenkins-hbase4.apache.org/44607] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/export-test/export-1689455464100 2023-07-15 21:11:04,100 INFO [Listener at jenkins-hbase4.apache.org/44607] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:45529, tgtDir=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/export-test/export-1689455464100, rawTgtDir=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/export-test/export-1689455464100, srcFsUri=hdfs://localhost:45529, srcDir=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f 2023-07-15 21:11:04,145 DEBUG [Listener at jenkins-hbase4.apache.org/44607] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45529, inputRoot=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f 2023-07-15 21:11:04,145 DEBUG [Listener at jenkins-hbase4.apache.org/44607] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-226071728_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/export-test/export-1689455464100, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/export-test/export-1689455464100/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-15 21:11:04,145 INFO [Listener at jenkins-hbase4.apache.org/44607] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45529, inputRoot=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f, snapshotDir=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-15 21:11:04,162 INFO [Listener at jenkins-hbase4.apache.org/44607] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/export-test/export-1689455464100/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-15 21:11:04,218 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:04,219 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:04,220 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:04,220 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:04,221 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:04,221 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:04,222 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:04,309 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/hadoop-7884023747697499425.jar 2023-07-15 21:11:04,310 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:04,310 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:04,311 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:04,311 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:04,312 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:04,312 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:04,313 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-15 21:11:04,314 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-15 21:11:04,314 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-15 21:11:04,315 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-15 21:11:04,315 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-15 21:11:04,316 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-15 21:11:04,316 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-15 21:11:04,317 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-15 21:11:04,317 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-15 21:11:04,318 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-15 21:11:04,322 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 21:11:04,323 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 21:11:04,324 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 21:11:04,324 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 21:11:04,325 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 21:11:04,326 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 21:11:04,326 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 21:11:06,111 WARN [Listener at jenkins-hbase4.apache.org/44607] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-15 21:11:06,118 INFO [Listener at jenkins-hbase4.apache.org/44607] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-15 21:11:06,129 DEBUG [Listener at jenkins-hbase4.apache.org/44607] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-15 21:11:06,696 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 21:11:06,698 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 21:11:07,319 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689455460014_0001_000001 (auth:SIMPLE) 2023-07-15 21:11:07,520 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-15 21:11:12,713 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689455460014_0001_000001 (auth:SIMPLE) 2023-07-15 21:11:14,996 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689455460014_0001_000001 (auth:SIMPLE) 2023-07-15 21:11:18,446 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689455460014_0001_000001 (auth:SIMPLE) 2023-07-15 21:11:20,100 INFO [Listener at jenkins-hbase4.apache.org/44607] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-15 21:11:20,102 INFO [Listener at jenkins-hbase4.apache.org/44607] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-15 21:11:20,110 INFO [Listener at jenkins-hbase4.apache.org/44607] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-15 21:11:20,110 INFO [Listener at jenkins-hbase4.apache.org/44607] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-15 21:11:20,111 INFO [Listener at jenkins-hbase4.apache.org/44607] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-15 21:11:20,111 DEBUG [Listener at jenkins-hbase4.apache.org/44607] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_404915474_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-15 21:11:20,112 DEBUG [Listener at jenkins-hbase4.apache.org/44607] snapshot.TestExportSnapshot(367): hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-15 21:11:20,112 DEBUG [Listener at jenkins-hbase4.apache.org/44607] snapshot.TestExportSnapshot(367): hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-15 21:11:20,112 DEBUG [Listener at jenkins-hbase4.apache.org/44607] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_404915474_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/export-test/export-1689455464100/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/export-test/export-1689455464100/.hbase-snapshot/testExportWithTargetName 2023-07-15 21:11:20,112 DEBUG [Listener at jenkins-hbase4.apache.org/44607] snapshot.TestExportSnapshot(367): hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/export-test/export-1689455464100/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-15 21:11:20,113 DEBUG [Listener at jenkins-hbase4.apache.org/44607] snapshot.TestExportSnapshot(367): hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/export-test/export-1689455464100/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-15 21:11:20,122 INFO [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-15 21:11:20,127 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-15 21:11:20,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-15 21:11:20,139 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689455480139"}]},"ts":"1689455480139"} 2023-07-15 21:11:20,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-15 21:11:20,141 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-15 21:11:20,143 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-15 21:11:20,144 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=48713c654fcc87d50df7ae0bd9b18f06, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f23d7f07de3cbd08ce081e2353fab47a, UNASSIGN}] 2023-07-15 21:11:20,147 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=48713c654fcc87d50df7ae0bd9b18f06, UNASSIGN 2023-07-15 21:11:20,147 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f23d7f07de3cbd08ce081e2353fab47a, UNASSIGN 2023-07-15 21:11:20,147 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=f23d7f07de3cbd08ce081e2353fab47a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:20,147 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=48713c654fcc87d50df7ae0bd9b18f06, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:20,148 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689455461519.f23d7f07de3cbd08ce081e2353fab47a.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689455480147"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689455480147"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689455480147"}]},"ts":"1689455480147"} 2023-07-15 21:11:20,148 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689455461519.48713c654fcc87d50df7ae0bd9b18f06.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689455480147"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689455480147"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689455480147"}]},"ts":"1689455480147"} 2023-07-15 21:11:20,150 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure 48713c654fcc87d50df7ae0bd9b18f06, server=jenkins-hbase4.apache.org,44797,1689455451778}] 2023-07-15 21:11:20,150 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure f23d7f07de3cbd08ce081e2353fab47a, server=jenkins-hbase4.apache.org,38601,1689455451863}] 2023-07-15 21:11:20,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-15 21:11:20,310 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 48713c654fcc87d50df7ae0bd9b18f06 2023-07-15 21:11:20,310 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f23d7f07de3cbd08ce081e2353fab47a 2023-07-15 21:11:20,310 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 48713c654fcc87d50df7ae0bd9b18f06, disabling compactions & flushes 2023-07-15 21:11:20,310 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f23d7f07de3cbd08ce081e2353fab47a, disabling compactions & flushes 2023-07-15 21:11:20,311 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689455461519.48713c654fcc87d50df7ae0bd9b18f06. 2023-07-15 21:11:20,311 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689455461519.48713c654fcc87d50df7ae0bd9b18f06. 2023-07-15 21:11:20,311 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689455461519.48713c654fcc87d50df7ae0bd9b18f06. after waiting 0 ms 2023-07-15 21:11:20,311 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689455461519.48713c654fcc87d50df7ae0bd9b18f06. 2023-07-15 21:11:20,311 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689455461519.f23d7f07de3cbd08ce081e2353fab47a. 2023-07-15 21:11:20,311 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689455461519.f23d7f07de3cbd08ce081e2353fab47a. 2023-07-15 21:11:20,311 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689455461519.f23d7f07de3cbd08ce081e2353fab47a. after waiting 0 ms 2023-07-15 21:11:20,311 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689455461519.f23d7f07de3cbd08ce081e2353fab47a. 2023-07-15 21:11:20,330 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportWithTargetName/48713c654fcc87d50df7ae0bd9b18f06/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 21:11:20,331 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 21:11:20,332 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689455461519.48713c654fcc87d50df7ae0bd9b18f06. 2023-07-15 21:11:20,332 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 48713c654fcc87d50df7ae0bd9b18f06: 2023-07-15 21:11:20,333 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportWithTargetName/f23d7f07de3cbd08ce081e2353fab47a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 21:11:20,334 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 21:11:20,334 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689455461519.f23d7f07de3cbd08ce081e2353fab47a. 2023-07-15 21:11:20,335 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f23d7f07de3cbd08ce081e2353fab47a: 2023-07-15 21:11:20,337 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 48713c654fcc87d50df7ae0bd9b18f06 2023-07-15 21:11:20,338 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=48713c654fcc87d50df7ae0bd9b18f06, regionState=CLOSED 2023-07-15 21:11:20,338 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f23d7f07de3cbd08ce081e2353fab47a 2023-07-15 21:11:20,338 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689455461519.48713c654fcc87d50df7ae0bd9b18f06.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689455480338"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689455480338"}]},"ts":"1689455480338"} 2023-07-15 21:11:20,339 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=f23d7f07de3cbd08ce081e2353fab47a, regionState=CLOSED 2023-07-15 21:11:20,339 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689455461519.f23d7f07de3cbd08ce081e2353fab47a.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689455480339"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689455480339"}]},"ts":"1689455480339"} 2023-07-15 21:11:20,343 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=22 2023-07-15 21:11:20,343 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure 48713c654fcc87d50df7ae0bd9b18f06, server=jenkins-hbase4.apache.org,44797,1689455451778 in 190 msec 2023-07-15 21:11:20,345 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=23 2023-07-15 21:11:20,345 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure f23d7f07de3cbd08ce081e2353fab47a, server=jenkins-hbase4.apache.org,38601,1689455451863 in 191 msec 2023-07-15 21:11:20,346 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=48713c654fcc87d50df7ae0bd9b18f06, UNASSIGN in 200 msec 2023-07-15 21:11:20,347 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=21 2023-07-15 21:11:20,348 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f23d7f07de3cbd08ce081e2353fab47a, UNASSIGN in 201 msec 2023-07-15 21:11:20,349 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689455480348"}]},"ts":"1689455480348"} 2023-07-15 21:11:20,350 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-15 21:11:20,353 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-15 21:11:20,356 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 224 msec 2023-07-15 21:11:20,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-15 21:11:20,443 INFO [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-15 21:11:20,448 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-15 21:11:20,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-15 21:11:20,460 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-15 21:11:20,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-15 21:11:20,463 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-15 21:11:20,466 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35469] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-15 21:11:20,470 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 21:11:20,470 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 21:11:20,470 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 21:11:20,470 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 21:11:20,471 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-15 21:11:20,471 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-15 21:11:20,471 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-15 21:11:20,471 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-15 21:11:20,472 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 21:11:20,472 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 21:11:20,472 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:11:20,472 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportWithTargetName/f23d7f07de3cbd08ce081e2353fab47a 2023-07-15 21:11:20,472 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 21:11:20,472 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:11:20,472 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportWithTargetName/48713c654fcc87d50df7ae0bd9b18f06 2023-07-15 21:11:20,472 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 21:11:20,472 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:11:20,473 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:11:20,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-15 21:11:20,477 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportWithTargetName/48713c654fcc87d50df7ae0bd9b18f06/cf, FileablePath, hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportWithTargetName/48713c654fcc87d50df7ae0bd9b18f06/recovered.edits] 2023-07-15 21:11:20,477 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportWithTargetName/f23d7f07de3cbd08ce081e2353fab47a/cf, FileablePath, hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportWithTargetName/f23d7f07de3cbd08ce081e2353fab47a/recovered.edits] 2023-07-15 21:11:20,485 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportWithTargetName/f23d7f07de3cbd08ce081e2353fab47a/cf/8b1b0da01efa40288db086c6846765f8 to hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/archive/data/default/testtb-testExportWithTargetName/f23d7f07de3cbd08ce081e2353fab47a/cf/8b1b0da01efa40288db086c6846765f8 2023-07-15 21:11:20,485 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportWithTargetName/48713c654fcc87d50df7ae0bd9b18f06/cf/cc88a4ec9f2a457680b0f88a9cded054 to hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/archive/data/default/testtb-testExportWithTargetName/48713c654fcc87d50df7ae0bd9b18f06/cf/cc88a4ec9f2a457680b0f88a9cded054 2023-07-15 21:11:20,489 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportWithTargetName/f23d7f07de3cbd08ce081e2353fab47a/recovered.edits/9.seqid to hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/archive/data/default/testtb-testExportWithTargetName/f23d7f07de3cbd08ce081e2353fab47a/recovered.edits/9.seqid 2023-07-15 21:11:20,489 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportWithTargetName/48713c654fcc87d50df7ae0bd9b18f06/recovered.edits/9.seqid to hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/archive/data/default/testtb-testExportWithTargetName/48713c654fcc87d50df7ae0bd9b18f06/recovered.edits/9.seqid 2023-07-15 21:11:20,490 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportWithTargetName/f23d7f07de3cbd08ce081e2353fab47a 2023-07-15 21:11:20,490 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportWithTargetName/48713c654fcc87d50df7ae0bd9b18f06 2023-07-15 21:11:20,491 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-15 21:11:20,494 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-15 21:11:20,516 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-15 21:11:20,520 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-15 21:11:20,523 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-15 21:11:20,523 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-15 21:11:20,523 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689455461519.48713c654fcc87d50df7ae0bd9b18f06.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689455480523"}]},"ts":"9223372036854775807"} 2023-07-15 21:11:20,523 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689455461519.f23d7f07de3cbd08ce081e2353fab47a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689455480523"}]},"ts":"9223372036854775807"} 2023-07-15 21:11:20,529 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-15 21:11:20,529 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 48713c654fcc87d50df7ae0bd9b18f06, NAME => 'testtb-testExportWithTargetName,,1689455461519.48713c654fcc87d50df7ae0bd9b18f06.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => f23d7f07de3cbd08ce081e2353fab47a, NAME => 'testtb-testExportWithTargetName,1,1689455461519.f23d7f07de3cbd08ce081e2353fab47a.', STARTKEY => '1', ENDKEY => ''}] 2023-07-15 21:11:20,529 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-15 21:11:20,529 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689455480529"}]},"ts":"9223372036854775807"} 2023-07-15 21:11:20,532 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-15 21:11:20,535 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-15 21:11:20,537 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 85 msec 2023-07-15 21:11:20,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-15 21:11:20,577 INFO [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-15 21:11:20,595 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-15 21:11:20,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:20,601 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-15 21:11:20,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-15 21:11:20,633 INFO [Listener at jenkins-hbase4.apache.org/44607] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=756 (was 709) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_404915474_17 at /127.0.0.1:51014 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1282 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x7100f96f-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/cluster_744bf9ce-7834-b46f-9b3b-2856eea562b1/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_404915474_17 at /127.0.0.1:38332 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_404915474_17 at /127.0.0.1:56480 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/cluster_744bf9ce-7834-b46f-9b3b-2856eea562b1/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/cluster_744bf9ce-7834-b46f-9b3b-2856eea562b1/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7100f96f-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_52366983_1 at /127.0.0.1:56456 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1488416207) connection to jenkins-hbase4.apache.org/172.31.14.131:46767 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/cluster_744bf9ce-7834-b46f-9b3b-2856eea562b1/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1488416207) connection to jenkins-hbase4.apache.org/172.31.14.131:34347 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7100f96f-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7100f96f-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/cluster_744bf9ce-7834-b46f-9b3b-2856eea562b1/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/cluster_744bf9ce-7834-b46f-9b3b-2856eea562b1/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_52366983_1 at /127.0.0.1:50988 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=922 (was 896) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=303 (was 293) - SystemLoadAverage LEAK? -, ProcessCount=180 (was 174) - ProcessCount LEAK? -, AvailableMemoryMB=3220 (was 4837) 2023-07-15 21:11:20,634 WARN [Listener at jenkins-hbase4.apache.org/44607] hbase.ResourceChecker(130): Thread=756 is superior to 500 2023-07-15 21:11:20,659 INFO [Listener at jenkins-hbase4.apache.org/44607] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=756, OpenFileDescriptor=922, MaxFileDescriptor=60000, SystemLoadAverage=303, ProcessCount=180, AvailableMemoryMB=3218 2023-07-15 21:11:20,659 WARN [Listener at jenkins-hbase4.apache.org/44607] hbase.ResourceChecker(130): Thread=756 is superior to 500 2023-07-15 21:11:20,662 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-15 21:11:20,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-15 21:11:20,669 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 21:11:20,669 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-15 21:11:20,670 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 21:11:20,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-15 21:11:20,673 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemState/b24331db021a3106148f964b61981461 2023-07-15 21:11:20,673 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemState/432b04ada69f879ff6e1aaff53543212 2023-07-15 21:11:20,674 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemState/b24331db021a3106148f964b61981461 empty. 2023-07-15 21:11:20,674 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemState/432b04ada69f879ff6e1aaff53543212 empty. 2023-07-15 21:11:20,675 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemState/b24331db021a3106148f964b61981461 2023-07-15 21:11:20,675 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemState/432b04ada69f879ff6e1aaff53543212 2023-07-15 21:11:20,675 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-15 21:11:20,694 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-15 21:11:20,696 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 432b04ada69f879ff6e1aaff53543212, NAME => 'testtb-testExportFileSystemState,1,1689455480661.432b04ada69f879ff6e1aaff53543212.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp 2023-07-15 21:11:20,696 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => b24331db021a3106148f964b61981461, NAME => 'testtb-testExportFileSystemState,,1689455480661.b24331db021a3106148f964b61981461.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp 2023-07-15 21:11:20,729 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689455480661.432b04ada69f879ff6e1aaff53543212.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:11:20,730 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 432b04ada69f879ff6e1aaff53543212, disabling compactions & flushes 2023-07-15 21:11:20,730 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689455480661.432b04ada69f879ff6e1aaff53543212. 2023-07-15 21:11:20,730 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689455480661.432b04ada69f879ff6e1aaff53543212. 2023-07-15 21:11:20,730 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689455480661.432b04ada69f879ff6e1aaff53543212. after waiting 0 ms 2023-07-15 21:11:20,730 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689455480661.432b04ada69f879ff6e1aaff53543212. 2023-07-15 21:11:20,730 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689455480661.432b04ada69f879ff6e1aaff53543212. 2023-07-15 21:11:20,730 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 432b04ada69f879ff6e1aaff53543212: 2023-07-15 21:11:20,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-15 21:11:20,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-15 21:11:21,131 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689455480661.b24331db021a3106148f964b61981461.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:11:21,131 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing b24331db021a3106148f964b61981461, disabling compactions & flushes 2023-07-15 21:11:21,131 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689455480661.b24331db021a3106148f964b61981461. 2023-07-15 21:11:21,131 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689455480661.b24331db021a3106148f964b61981461. 2023-07-15 21:11:21,131 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689455480661.b24331db021a3106148f964b61981461. after waiting 0 ms 2023-07-15 21:11:21,131 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689455480661.b24331db021a3106148f964b61981461. 2023-07-15 21:11:21,131 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689455480661.b24331db021a3106148f964b61981461. 2023-07-15 21:11:21,131 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for b24331db021a3106148f964b61981461: 2023-07-15 21:11:21,135 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 21:11:21,136 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689455480661.432b04ada69f879ff6e1aaff53543212.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689455481136"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689455481136"}]},"ts":"1689455481136"} 2023-07-15 21:11:21,136 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689455480661.b24331db021a3106148f964b61981461.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689455481136"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689455481136"}]},"ts":"1689455481136"} 2023-07-15 21:11:21,139 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-15 21:11:21,140 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 21:11:21,140 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689455481140"}]},"ts":"1689455481140"} 2023-07-15 21:11:21,142 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-15 21:11:21,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-15 21:11:21,358 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 21:11:21,360 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 21:11:21,360 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 21:11:21,360 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 21:11:21,360 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 21:11:21,360 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b24331db021a3106148f964b61981461, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=432b04ada69f879ff6e1aaff53543212, ASSIGN}] 2023-07-15 21:11:21,364 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=432b04ada69f879ff6e1aaff53543212, ASSIGN 2023-07-15 21:11:21,364 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b24331db021a3106148f964b61981461, ASSIGN 2023-07-15 21:11:21,365 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b24331db021a3106148f964b61981461, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35469,1689455451912; forceNewPlan=false, retain=false 2023-07-15 21:11:21,365 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=432b04ada69f879ff6e1aaff53543212, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44797,1689455451778; forceNewPlan=false, retain=false 2023-07-15 21:11:21,515 INFO [jenkins-hbase4:44929] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-15 21:11:21,518 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=432b04ada69f879ff6e1aaff53543212, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:21,518 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=b24331db021a3106148f964b61981461, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:21,518 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689455480661.432b04ada69f879ff6e1aaff53543212.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689455481518"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689455481518"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689455481518"}]},"ts":"1689455481518"} 2023-07-15 21:11:21,518 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689455480661.b24331db021a3106148f964b61981461.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689455481518"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689455481518"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689455481518"}]},"ts":"1689455481518"} 2023-07-15 21:11:21,520 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure 432b04ada69f879ff6e1aaff53543212, server=jenkins-hbase4.apache.org,44797,1689455451778}] 2023-07-15 21:11:21,521 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure b24331db021a3106148f964b61981461, server=jenkins-hbase4.apache.org,35469,1689455451912}] 2023-07-15 21:11:21,681 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689455480661.432b04ada69f879ff6e1aaff53543212. 2023-07-15 21:11:21,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 432b04ada69f879ff6e1aaff53543212, NAME => 'testtb-testExportFileSystemState,1,1689455480661.432b04ada69f879ff6e1aaff53543212.', STARTKEY => '1', ENDKEY => ''} 2023-07-15 21:11:21,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689455480661.432b04ada69f879ff6e1aaff53543212. service=AccessControlService 2023-07-15 21:11:21,681 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 21:11:21,682 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689455480661.b24331db021a3106148f964b61981461. 2023-07-15 21:11:21,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 432b04ada69f879ff6e1aaff53543212 2023-07-15 21:11:21,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689455480661.432b04ada69f879ff6e1aaff53543212.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:11:21,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b24331db021a3106148f964b61981461, NAME => 'testtb-testExportFileSystemState,,1689455480661.b24331db021a3106148f964b61981461.', STARTKEY => '', ENDKEY => '1'} 2023-07-15 21:11:21,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 432b04ada69f879ff6e1aaff53543212 2023-07-15 21:11:21,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 432b04ada69f879ff6e1aaff53543212 2023-07-15 21:11:21,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689455480661.b24331db021a3106148f964b61981461. service=AccessControlService 2023-07-15 21:11:21,683 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 21:11:21,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState b24331db021a3106148f964b61981461 2023-07-15 21:11:21,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689455480661.b24331db021a3106148f964b61981461.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:11:21,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b24331db021a3106148f964b61981461 2023-07-15 21:11:21,683 INFO [StoreOpener-432b04ada69f879ff6e1aaff53543212-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 432b04ada69f879ff6e1aaff53543212 2023-07-15 21:11:21,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b24331db021a3106148f964b61981461 2023-07-15 21:11:21,685 INFO [StoreOpener-b24331db021a3106148f964b61981461-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b24331db021a3106148f964b61981461 2023-07-15 21:11:21,685 DEBUG [StoreOpener-432b04ada69f879ff6e1aaff53543212-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemState/432b04ada69f879ff6e1aaff53543212/cf 2023-07-15 21:11:21,685 DEBUG [StoreOpener-432b04ada69f879ff6e1aaff53543212-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemState/432b04ada69f879ff6e1aaff53543212/cf 2023-07-15 21:11:21,685 INFO [StoreOpener-432b04ada69f879ff6e1aaff53543212-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 432b04ada69f879ff6e1aaff53543212 columnFamilyName cf 2023-07-15 21:11:21,686 INFO [StoreOpener-432b04ada69f879ff6e1aaff53543212-1] regionserver.HStore(310): Store=432b04ada69f879ff6e1aaff53543212/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 21:11:21,686 DEBUG [StoreOpener-b24331db021a3106148f964b61981461-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemState/b24331db021a3106148f964b61981461/cf 2023-07-15 21:11:21,687 DEBUG [StoreOpener-b24331db021a3106148f964b61981461-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemState/b24331db021a3106148f964b61981461/cf 2023-07-15 21:11:21,687 INFO [StoreOpener-b24331db021a3106148f964b61981461-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b24331db021a3106148f964b61981461 columnFamilyName cf 2023-07-15 21:11:21,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemState/432b04ada69f879ff6e1aaff53543212 2023-07-15 21:11:21,688 INFO [StoreOpener-b24331db021a3106148f964b61981461-1] regionserver.HStore(310): Store=b24331db021a3106148f964b61981461/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 21:11:21,689 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemState/432b04ada69f879ff6e1aaff53543212 2023-07-15 21:11:21,689 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemState/b24331db021a3106148f964b61981461 2023-07-15 21:11:21,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemState/b24331db021a3106148f964b61981461 2023-07-15 21:11:21,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 432b04ada69f879ff6e1aaff53543212 2023-07-15 21:11:21,693 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b24331db021a3106148f964b61981461 2023-07-15 21:11:21,694 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemState/432b04ada69f879ff6e1aaff53543212/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 21:11:21,695 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 432b04ada69f879ff6e1aaff53543212; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67246969, jitterRate=0.0020579248666763306}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 21:11:21,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 432b04ada69f879ff6e1aaff53543212: 2023-07-15 21:11:21,696 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemState/b24331db021a3106148f964b61981461/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 21:11:21,696 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689455480661.432b04ada69f879ff6e1aaff53543212., pid=30, masterSystemTime=1689455481673 2023-07-15 21:11:21,696 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b24331db021a3106148f964b61981461; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73931109, jitterRate=0.1016593724489212}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 21:11:21,696 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b24331db021a3106148f964b61981461: 2023-07-15 21:11:21,697 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689455480661.b24331db021a3106148f964b61981461., pid=31, masterSystemTime=1689455481673 2023-07-15 21:11:21,698 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689455480661.432b04ada69f879ff6e1aaff53543212. 2023-07-15 21:11:21,698 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689455480661.432b04ada69f879ff6e1aaff53543212. 2023-07-15 21:11:21,699 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=432b04ada69f879ff6e1aaff53543212, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:21,699 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689455480661.b24331db021a3106148f964b61981461. 2023-07-15 21:11:21,699 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689455480661.b24331db021a3106148f964b61981461. 2023-07-15 21:11:21,699 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689455480661.432b04ada69f879ff6e1aaff53543212.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689455481699"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689455481699"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689455481699"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689455481699"}]},"ts":"1689455481699"} 2023-07-15 21:11:21,700 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=b24331db021a3106148f964b61981461, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:21,700 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689455480661.b24331db021a3106148f964b61981461.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689455481700"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689455481700"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689455481700"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689455481700"}]},"ts":"1689455481700"} 2023-07-15 21:11:21,704 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=29 2023-07-15 21:11:21,706 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure 432b04ada69f879ff6e1aaff53543212, server=jenkins-hbase4.apache.org,44797,1689455451778 in 181 msec 2023-07-15 21:11:21,707 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=28 2023-07-15 21:11:21,709 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure b24331db021a3106148f964b61981461, server=jenkins-hbase4.apache.org,35469,1689455451912 in 181 msec 2023-07-15 21:11:21,709 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=432b04ada69f879ff6e1aaff53543212, ASSIGN in 346 msec 2023-07-15 21:11:21,712 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-07-15 21:11:21,712 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b24331db021a3106148f964b61981461, ASSIGN in 347 msec 2023-07-15 21:11:21,712 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 21:11:21,713 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689455481712"}]},"ts":"1689455481712"} 2023-07-15 21:11:21,714 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-15 21:11:21,767 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 21:11:21,767 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-15 21:11:21,769 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35469] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-15 21:11:21,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-15 21:11:21,858 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:11:21,858 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:11:21,858 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:11:21,858 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:11:21,951 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-15 21:11:21,951 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-15 21:11:21,951 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-15 21:11:21,951 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-15 21:11:21,953 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 1.2880 sec 2023-07-15 21:11:22,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-15 21:11:22,779 INFO [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-15 21:11:22,780 DEBUG [Listener at jenkins-hbase4.apache.org/44607] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemState get assigned. Timeout = 60000ms 2023-07-15 21:11:22,780 INFO [Listener at jenkins-hbase4.apache.org/44607] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 21:11:22,783 INFO [Listener at jenkins-hbase4.apache.org/44607] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemState assigned to meta. Checking AM states. 2023-07-15 21:11:22,784 INFO [Listener at jenkins-hbase4.apache.org/44607] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 21:11:22,784 INFO [Listener at jenkins-hbase4.apache.org/44607] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemState assigned. 2023-07-15 21:11:22,787 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 21:11:22,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689455482787 (current time:1689455482787). 2023-07-15 21:11:22,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 21:11:22,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] zookeeper.ReadOnlyZKClient(139): Connect 0x6b5921c1 to 127.0.0.1:57175 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 21:11:22,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5b486c37, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 21:11:22,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:11:22,847 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43602, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:11:22,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6b5921c1 to 127.0.0.1:57175 2023-07-15 21:11:22,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 21:11:22,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] zookeeper.ReadOnlyZKClient(139): Connect 0x71bcbe78 to 127.0.0.1:57175 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 21:11:22,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@53c9cea7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 21:11:22,922 DEBUG [hconnection-0x4b78393d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:11:22,925 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43604, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:11:22,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:11:22,931 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42744, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:11:22,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x71bcbe78 to 127.0.0.1:57175 2023-07-15 21:11:22,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 21:11:22,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-15 21:11:22,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 21:11:22,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 21:11:22,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-15 21:11:22,938 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-15 21:11:22,939 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689456082939 2023-07-15 21:11:22,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 21:11:22,939 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-15 21:11:22,940 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 21:11:22,940 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 21:11:22,941 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-15 21:11:22,942 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-15 21:11:22,943 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-15 21:11:22,944 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-15 21:11:22,945 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689456082945 2023-07-15 21:11:22,962 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:22,962 INFO [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-15 21:11:22,962 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:11:22,963 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-15 21:11:22,964 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-15 21:11:22,973 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:22,973 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,040 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 21:11:23,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 21:11:23,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-15 21:11:23,042 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 21:11:23,050 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:11:23,050 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:11:23,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:11:23,050 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:23,050 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:11:23,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:11:23,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:11:23,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:11:23,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:11:23,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:11:23,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,051 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:23,051 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:23,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,051 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,051 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:23,052 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 21:11:23,051 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,052 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-15 21:11:23,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-15 21:11:23,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,052 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-15 21:11:23,052 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-15 21:11:23,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-15 21:11:23,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,052 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-15 21:11:23,053 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,053 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,053 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,053 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-15 21:11:23,053 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-15 21:11:23,053 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:11:23,053 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-15 21:11:23,053 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:11:23,055 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:11:23,056 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-15 21:11:23,057 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-15 21:11:23,057 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-15 21:11:23,057 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-15 21:11:23,057 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35469,1689455451912' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-15 21:11:23,056 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-15 21:11:23,057 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38601,1689455451863' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-15 21:11:23,057 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-15 21:11:23,057 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44797,1689455451778' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-15 21:11:23,073 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:23,073 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:23,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:11:23,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:11:23,166 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:11:23,166 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,166 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,166 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:23,166 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:11:23,166 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:11:23,166 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:11:23,166 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,166 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:11:23,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:23,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:23,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:23,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:11:23,168 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35469,1689455451912' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-15 21:11:23,168 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4cc4c076[Count = 1] remaining members to acquire global barrier 2023-07-15 21:11:23,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:23,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:11:23,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:11:23,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:11:23,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:11:23,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:23,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:23,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:23,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:11:23,170 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44797,1689455451778' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-15 21:11:23,171 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4cc4c076[Count = 0] remaining members to acquire global barrier 2023-07-15 21:11:23,171 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-15 21:11:23,171 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,181 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,181 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,181 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,181 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-15 21:11:23,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,181 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:23,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,181 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 21:11:23,182 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 21:11:23,181 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-15 21:11:23,182 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-15 21:11:23,182 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,38601,1689455451863' in zk 2023-07-15 21:11:23,181 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-15 21:11:23,182 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:23,182 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 21:11:23,182 DEBUG [rs(jenkins-hbase4.apache.org,35469,1689455451912)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689455480661.b24331db021a3106148f964b61981461. 2023-07-15 21:11:23,182 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 21:11:23,182 DEBUG [rs(jenkins-hbase4.apache.org,35469,1689455451912)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689455480661.b24331db021a3106148f964b61981461. started... 2023-07-15 21:11:23,182 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 21:11:23,182 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689455480661.432b04ada69f879ff6e1aaff53543212. 2023-07-15 21:11:23,182 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689455480661.432b04ada69f879ff6e1aaff53543212. started... 2023-07-15 21:11:23,184 DEBUG [rs(jenkins-hbase4.apache.org,35469,1689455451912)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b24331db021a3106148f964b61981461: 2023-07-15 21:11:23,185 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 432b04ada69f879ff6e1aaff53543212: 2023-07-15 21:11:23,185 DEBUG [rs(jenkins-hbase4.apache.org,35469,1689455451912)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689455480661.b24331db021a3106148f964b61981461.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,185 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689455480661.432b04ada69f879ff6e1aaff53543212.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,185 DEBUG [rs(jenkins-hbase4.apache.org,35469,1689455451912)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 21:11:23,185 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 21:11:23,185 DEBUG [rs(jenkins-hbase4.apache.org,35469,1689455451912)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 21:11:23,185 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 21:11:23,202 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-15 21:11:23,202 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:11:23,202 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-15 21:11:23,206 DEBUG [rs(jenkins-hbase4.apache.org,35469,1689455451912)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689455480661.b24331db021a3106148f964b61981461. completed. 2023-07-15 21:11:23,206 DEBUG [rs(jenkins-hbase4.apache.org,35469,1689455451912)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689455480661.b24331db021a3106148f964b61981461. 2023-07-15 21:11:23,206 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 21:11:23,206 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 21:11:23,206 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:23,206 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-15 21:11:23,206 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35469,1689455451912' in zk 2023-07-15 21:11:23,206 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689455480661.432b04ada69f879ff6e1aaff53543212. completed. 2023-07-15 21:11:23,206 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689455480661.432b04ada69f879ff6e1aaff53543212. 2023-07-15 21:11:23,207 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 21:11:23,207 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 21:11:23,207 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:23,207 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-15 21:11:23,207 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44797,1689455451778' in zk 2023-07-15 21:11:23,242 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 21:11:23,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 21:11:23,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-15 21:11:23,243 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-15 21:11:23,258 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-15 21:11:23,258 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:23,258 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:11:23,258 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-15 21:11:23,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:23,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:11:23,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:11:23,296 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:23,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:11:23,296 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-15 21:11:23,296 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:11:23,296 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-15 21:11:23,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:11:23,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:23,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:23,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:23,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:11:23,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:23,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:23,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:23,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,35469,1689455451912': 2023-07-15 21:11:23,301 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35469,1689455451912' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-15 21:11:23,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:23,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:11:23,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:11:23,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:11:23,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:11:23,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:23,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:23,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:23,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:11:23,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:23,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:23,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:23,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,44797,1689455451778': 2023-07-15 21:11:23,305 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44797,1689455451778' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-15 21:11:23,305 INFO [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-15 21:11:23,305 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 21:11:23,305 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 21:11:23,305 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,305 INFO [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 21:11:23,358 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,358 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,358 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,358 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,358 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:11:23,358 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:11:23,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:11:23,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:11:23,359 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:23,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:11:23,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,358 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:11:23,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:11:23,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:11:23,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:11:23,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:11:23,359 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:23,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:11:23,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:11:23,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,360 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:23,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:11:23,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:23,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:23,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:23,363 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:23,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:11:23,363 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:23,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,364 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:23,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:23,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:23,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:23,404 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:23,404 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:11:23,404 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:11:23,404 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:11:23,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:11:23,404 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:23,405 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:11:23,405 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:11:23,405 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:11:23,405 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:11:23,405 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:11:23,405 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:23,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:11:23,407 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,405 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:11:23,407 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:23,405 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:11:23,407 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,405 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:11:23,407 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:11:23,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:11:23,407 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:23,407 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:23,407 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,407 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,407 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:11:23,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:11:23,408 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:11:23,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:11:23,436 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,479 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-15 21:11:23,479 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,480 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,480 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689455482939Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689455483407 (+468 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689455483407Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689455483412 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689455483427 (+15 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689455483479 (+52 ms) 2023-07-15 21:11:23,482 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-15 21:11:23,484 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 542 msec 2023-07-15 21:11:23,543 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 21:11:23,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 21:11:23,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 21:11:23,557 DEBUG [htable-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:11:23,561 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42750, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:11:23,561 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35469] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689455480661.b24331db021a3106148f964b61981461. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 21:11:23,561 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44797] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689455480661.432b04ada69f879ff6e1aaff53543212. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 21:11:23,581 DEBUG [Listener at jenkins-hbase4.apache.org/44607] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-15 21:11:23,581 DEBUG [Listener at jenkins-hbase4.apache.org/44607] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689455480661.b24331db021a3106148f964b61981461. 2023-07-15 21:11:23,583 INFO [Listener at jenkins-hbase4.apache.org/44607] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 21:11:23,608 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 21:11:23,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689455483608 (current time:1689455483608). 2023-07-15 21:11:23,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 21:11:23,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] zookeeper.ReadOnlyZKClient(139): Connect 0x285b060c to 127.0.0.1:57175 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 21:11:23,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@53e149fc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 21:11:23,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:11:23,630 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43610, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:11:23,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x285b060c to 127.0.0.1:57175 2023-07-15 21:11:23,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 21:11:23,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] zookeeper.ReadOnlyZKClient(139): Connect 0x443a0601 to 127.0.0.1:57175 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 21:11:23,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6d56122d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 21:11:23,741 DEBUG [hconnection-0x7b426068-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:11:23,742 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43622, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:11:23,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:11:23,751 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42752, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:11:23,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x443a0601 to 127.0.0.1:57175 2023-07-15 21:11:23,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 21:11:23,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-15 21:11:23,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 21:11:23,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 21:11:23,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-15 21:11:23,766 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-15 21:11:23,767 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689456083767 2023-07-15 21:11:23,768 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-15 21:11:23,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 21:11:23,789 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 21:11:23,789 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 21:11:23,790 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-15 21:11:23,798 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-15 21:11:23,800 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 42 msec 2023-07-15 21:11:23,802 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-15 21:11:23,803 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689456083803 2023-07-15 21:11:23,860 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-15 21:11:23,860 INFO [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-15 21:11:23,861 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:11:23,862 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-15 21:11:23,862 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-15 21:11:23,863 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,863 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,864 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:11:23,864 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:11:23,864 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:11:23,864 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:23,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:11:23,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:11:23,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:11:23,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:11:23,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:11:23,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:11:23,865 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:23,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,865 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:23,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,865 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,866 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,866 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:23,866 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 21:11:23,866 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-15 21:11:23,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-15 21:11:23,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,866 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-15 21:11:23,867 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-15 21:11:23,867 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-15 21:11:23,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-15 21:11:23,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,867 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-15 21:11:23,867 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:11:23,867 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-15 21:11:23,870 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-15 21:11:23,872 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-15 21:11:23,872 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-15 21:11:23,872 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-15 21:11:23,872 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:11:23,872 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44797,1689455451778' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-15 21:11:23,874 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:23,874 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:23,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:11:23,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:11:23,874 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,874 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:11:23,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:11:23,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:11:23,877 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-15 21:11:23,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 21:11:23,879 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-15 21:11:23,879 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:11:23,879 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-15 21:11:23,880 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-15 21:11:23,880 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-15 21:11:23,880 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-15 21:11:23,880 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35469,1689455451912' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-15 21:11:23,880 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38601,1689455451863' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-15 21:11:23,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:23,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:11:23,887 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:23,888 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,889 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,889 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,889 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:11:23,889 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44797,1689455451778' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-15 21:11:23,889 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@72b2e052[Count = 1] remaining members to acquire global barrier 2023-07-15 21:11:23,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:23,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:11:23,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:11:23,889 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,889 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:11:23,889 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 21:11:23,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:11:23,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:11:23,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 21:11:23,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 21:11:23,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:23,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-15 21:11:23,891 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 21:11:23,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:23,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:23,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:11:23,892 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35469,1689455451912' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-15 21:11:23,892 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@72b2e052[Count = 0] remaining members to acquire global barrier 2023-07-15 21:11:23,892 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-15 21:11:23,892 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,894 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,894 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,894 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,894 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,894 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,894 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,894 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-15 21:11:23,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,894 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:23,894 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-15 21:11:23,894 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-15 21:11:23,895 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-15 21:11:23,895 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,38601,1689455451863' in zk 2023-07-15 21:11:23,895 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:23,895 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 21:11:23,897 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-15 21:11:23,897 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:11:23,897 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-15 21:11:23,900 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 21:11:23,900 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 21:11:23,900 DEBUG [rs(jenkins-hbase4.apache.org,35469,1689455451912)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689455480661.b24331db021a3106148f964b61981461. 2023-07-15 21:11:23,900 DEBUG [rs(jenkins-hbase4.apache.org,35469,1689455451912)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689455480661.b24331db021a3106148f964b61981461. started... 2023-07-15 21:11:23,900 INFO [rs(jenkins-hbase4.apache.org,35469,1689455451912)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b24331db021a3106148f964b61981461 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-15 21:11:23,902 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 21:11:23,902 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 21:11:23,902 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689455480661.432b04ada69f879ff6e1aaff53543212. 2023-07-15 21:11:23,902 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689455480661.432b04ada69f879ff6e1aaff53543212. started... 2023-07-15 21:11:23,902 INFO [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 432b04ada69f879ff6e1aaff53543212 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-15 21:11:23,925 INFO [rs(jenkins-hbase4.apache.org,35469,1689455451912)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=132 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemState/b24331db021a3106148f964b61981461/.tmp/cf/1cd862c6326046bf99af26e8db40e246 2023-07-15 21:11:23,929 INFO [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.13 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemState/432b04ada69f879ff6e1aaff53543212/.tmp/cf/22f0caf7964d4b6ba8fa049706237ba2 2023-07-15 21:11:23,937 DEBUG [rs(jenkins-hbase4.apache.org,35469,1689455451912)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemState/b24331db021a3106148f964b61981461/.tmp/cf/1cd862c6326046bf99af26e8db40e246 as hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemState/b24331db021a3106148f964b61981461/cf/1cd862c6326046bf99af26e8db40e246 2023-07-15 21:11:23,940 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemState/432b04ada69f879ff6e1aaff53543212/.tmp/cf/22f0caf7964d4b6ba8fa049706237ba2 as hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemState/432b04ada69f879ff6e1aaff53543212/cf/22f0caf7964d4b6ba8fa049706237ba2 2023-07-15 21:11:23,944 INFO [rs(jenkins-hbase4.apache.org,35469,1689455451912)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemState/b24331db021a3106148f964b61981461/cf/1cd862c6326046bf99af26e8db40e246, entries=2, sequenceid=6, filesize=5.0 K 2023-07-15 21:11:23,946 INFO [rs(jenkins-hbase4.apache.org,35469,1689455451912)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for b24331db021a3106148f964b61981461 in 46ms, sequenceid=6, compaction requested=false 2023-07-15 21:11:23,946 DEBUG [rs(jenkins-hbase4.apache.org,35469,1689455451912)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-15 21:11:23,947 INFO [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemState/432b04ada69f879ff6e1aaff53543212/cf/22f0caf7964d4b6ba8fa049706237ba2, entries=48, sequenceid=6, filesize=8.1 K 2023-07-15 21:11:23,948 DEBUG [rs(jenkins-hbase4.apache.org,35469,1689455451912)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b24331db021a3106148f964b61981461: 2023-07-15 21:11:23,948 DEBUG [rs(jenkins-hbase4.apache.org,35469,1689455451912)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689455480661.b24331db021a3106148f964b61981461.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-15 21:11:23,948 DEBUG [rs(jenkins-hbase4.apache.org,35469,1689455451912)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 21:11:23,948 DEBUG [rs(jenkins-hbase4.apache.org,35469,1689455451912)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemState/b24331db021a3106148f964b61981461/cf/1cd862c6326046bf99af26e8db40e246] hfiles 2023-07-15 21:11:23,948 DEBUG [rs(jenkins-hbase4.apache.org,35469,1689455451912)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemState/b24331db021a3106148f964b61981461/cf/1cd862c6326046bf99af26e8db40e246 for snapshot=snaptb0-testExportFileSystemState 2023-07-15 21:11:23,949 INFO [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 432b04ada69f879ff6e1aaff53543212 in 47ms, sequenceid=6, compaction requested=false 2023-07-15 21:11:23,950 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 432b04ada69f879ff6e1aaff53543212: 2023-07-15 21:11:23,950 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689455480661.432b04ada69f879ff6e1aaff53543212.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-15 21:11:23,950 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 21:11:23,950 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemState/432b04ada69f879ff6e1aaff53543212/cf/22f0caf7964d4b6ba8fa049706237ba2] hfiles 2023-07-15 21:11:23,950 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemState/432b04ada69f879ff6e1aaff53543212/cf/22f0caf7964d4b6ba8fa049706237ba2 for snapshot=snaptb0-testExportFileSystemState 2023-07-15 21:11:23,960 DEBUG [rs(jenkins-hbase4.apache.org,35469,1689455451912)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689455480661.b24331db021a3106148f964b61981461. completed. 2023-07-15 21:11:23,960 DEBUG [rs(jenkins-hbase4.apache.org,35469,1689455451912)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689455480661.b24331db021a3106148f964b61981461. 2023-07-15 21:11:23,960 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 21:11:23,960 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689455480661.432b04ada69f879ff6e1aaff53543212. completed. 2023-07-15 21:11:23,960 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689455480661.432b04ada69f879ff6e1aaff53543212. 2023-07-15 21:11:23,960 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 21:11:23,961 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:23,960 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 21:11:23,961 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 21:11:23,961 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:23,961 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-15 21:11:23,961 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-15 21:11:23,961 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44797,1689455451778' in zk 2023-07-15 21:11:23,961 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35469,1689455451912' in zk 2023-07-15 21:11:23,966 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-15 21:11:23,966 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-15 21:11:23,966 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:23,966 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:11:23,966 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:23,966 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-15 21:11:23,966 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:11:23,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:23,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:11:23,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:11:23,968 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-15 21:11:23,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:11:23,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:11:23,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 21:11:23,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:23,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:23,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:23,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:11:23,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 21:11:23,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:23,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:23,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:23,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,44797,1689455451778': 2023-07-15 21:11:23,973 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44797,1689455451778' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-15 21:11:23,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:23,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:11:23,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:11:23,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:11:23,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:11:23,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 21:11:23,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:23,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:23,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:23,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:11:23,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 21:11:23,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:23,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:23,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:23,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,35469,1689455451912': 2023-07-15 21:11:23,976 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35469,1689455451912' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-15 21:11:23,976 INFO [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-15 21:11:23,976 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 21:11:23,976 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 21:11:23,976 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-15 21:11:23,976 INFO [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 21:11:23,978 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,978 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:11:23,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:11:23,978 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:11:23,978 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,978 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,978 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:11:23,978 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:11:23,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:11:23,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:11:23,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:11:23,979 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:23,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:11:23,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:11:23,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 21:11:23,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:11:23,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:11:23,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,979 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:23,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:11:23,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,980 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:23,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 21:11:23,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:23,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:23,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:23,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:11:23,982 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:23,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 21:11:23,982 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:23,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:23,982 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:23,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:23,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:23,985 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:23,985 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,985 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:11:23,985 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:11:23,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:11:23,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:11:23,985 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:23,986 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:23,986 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,986 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:11:23,986 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:11:23,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:11:23,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:11:23,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:11:23,986 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:11:23,986 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-15 21:11:23,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:11:23,986 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-15 21:11:23,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:11:23,986 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:11:23,986 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:23,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:11:23,986 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:11:23,988 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:11:23,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:11:23,988 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:23,988 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:23,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:11:23,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:11:23,988 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,988 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,989 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-15 21:11:24,013 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-15 21:11:24,037 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-15 21:11:24,037 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-15 21:11:24,038 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-15 21:11:24,038 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689455483768Consolidate snapshot: snaptb0-testExportFileSystemState at 1689455483986 (+218 ms)Loading Region manifests for snaptb0-testExportFileSystemState at 1689455483986Writing data manifest for snaptb0-testExportFileSystemState at 1689455483992 (+6 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689455484006 (+14 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689455484037 (+31 ms) 2023-07-15 21:11:24,040 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-15 21:11:24,042 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 251 msec 2023-07-15 21:11:24,091 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 21:11:24,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 21:11:24,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 21:11:24,095 INFO [Listener at jenkins-hbase4.apache.org/44607] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/export-test/export-1689455484095 2023-07-15 21:11:24,095 INFO [Listener at jenkins-hbase4.apache.org/44607] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:45529, tgtDir=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/export-test/export-1689455484095, rawTgtDir=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/export-test/export-1689455484095, srcFsUri=hdfs://localhost:45529, srcDir=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f 2023-07-15 21:11:24,127 DEBUG [Listener at jenkins-hbase4.apache.org/44607] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45529, inputRoot=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f 2023-07-15 21:11:24,127 DEBUG [Listener at jenkins-hbase4.apache.org/44607] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1141285274_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/export-test/export-1689455484095, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/export-test/export-1689455484095/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-15 21:11:24,127 INFO [Listener at jenkins-hbase4.apache.org/44607] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45529, inputRoot=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f, snapshotDir=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-15 21:11:24,154 INFO [Listener at jenkins-hbase4.apache.org/44607] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/export-test/export-1689455484095/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-15 21:11:24,187 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:24,188 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:24,188 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:24,188 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:24,189 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:24,189 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:24,189 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:24,261 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/hadoop-6274384738944013249.jar 2023-07-15 21:11:24,262 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:24,262 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:24,263 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:24,263 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:24,264 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:24,264 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:24,264 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-15 21:11:24,265 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-15 21:11:24,265 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-15 21:11:24,266 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-15 21:11:24,266 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-15 21:11:24,266 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-15 21:11:24,267 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-15 21:11:24,267 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-15 21:11:24,268 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-15 21:11:24,268 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-15 21:11:24,269 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 21:11:24,270 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 21:11:24,270 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 21:11:24,270 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 21:11:24,271 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 21:11:24,271 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 21:11:24,272 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 21:11:24,612 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689455460014_0001_000001 (auth:SIMPLE) 2023-07-15 21:11:25,107 WARN [Listener at jenkins-hbase4.apache.org/44607] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-15 21:11:25,109 INFO [Listener at jenkins-hbase4.apache.org/44607] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-15 21:11:25,112 DEBUG [Listener at jenkins-hbase4.apache.org/44607] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-15 21:11:25,235 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 21:11:25,235 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 21:11:25,442 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689455460014_0002_000001 (auth:SIMPLE) 2023-07-15 21:11:25,914 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-15 21:11:29,955 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689455460014_0002_000001 (auth:SIMPLE) 2023-07-15 21:11:32,174 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689455460014_0002_000001 (auth:SIMPLE) 2023-07-15 21:11:35,220 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689455460014_0002_000001 (auth:SIMPLE) 2023-07-15 21:11:36,401 INFO [Listener at jenkins-hbase4.apache.org/44607] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-15 21:11:36,402 INFO [Listener at jenkins-hbase4.apache.org/44607] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-15 21:11:36,410 INFO [Listener at jenkins-hbase4.apache.org/44607] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-15 21:11:36,410 INFO [Listener at jenkins-hbase4.apache.org/44607] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-15 21:11:36,411 INFO [Listener at jenkins-hbase4.apache.org/44607] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-15 21:11:36,411 DEBUG [Listener at jenkins-hbase4.apache.org/44607] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_404915474_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-15 21:11:36,411 DEBUG [Listener at jenkins-hbase4.apache.org/44607] snapshot.TestExportSnapshot(367): hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-15 21:11:36,411 DEBUG [Listener at jenkins-hbase4.apache.org/44607] snapshot.TestExportSnapshot(367): hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-15 21:11:36,412 DEBUG [Listener at jenkins-hbase4.apache.org/44607] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_404915474_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/export-test/export-1689455484095/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/export-test/export-1689455484095/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-15 21:11:36,412 DEBUG [Listener at jenkins-hbase4.apache.org/44607] snapshot.TestExportSnapshot(367): hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/export-test/export-1689455484095/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-15 21:11:36,412 DEBUG [Listener at jenkins-hbase4.apache.org/44607] snapshot.TestExportSnapshot(367): hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/export-test/export-1689455484095/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-15 21:11:36,419 INFO [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-15 21:11:36,419 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-15 21:11:36,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-15 21:11:36,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-15 21:11:36,425 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689455496425"}]},"ts":"1689455496425"} 2023-07-15 21:11:36,426 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-15 21:11:36,428 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-15 21:11:36,429 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b24331db021a3106148f964b61981461, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=432b04ada69f879ff6e1aaff53543212, UNASSIGN}] 2023-07-15 21:11:36,431 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b24331db021a3106148f964b61981461, UNASSIGN 2023-07-15 21:11:36,431 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=432b04ada69f879ff6e1aaff53543212, UNASSIGN 2023-07-15 21:11:36,432 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=b24331db021a3106148f964b61981461, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:36,432 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=432b04ada69f879ff6e1aaff53543212, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:36,432 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689455480661.b24331db021a3106148f964b61981461.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689455496432"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689455496432"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689455496432"}]},"ts":"1689455496432"} 2023-07-15 21:11:36,432 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689455480661.432b04ada69f879ff6e1aaff53543212.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689455496432"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689455496432"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689455496432"}]},"ts":"1689455496432"} 2023-07-15 21:11:36,434 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure 432b04ada69f879ff6e1aaff53543212, server=jenkins-hbase4.apache.org,44797,1689455451778}] 2023-07-15 21:11:36,435 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure b24331db021a3106148f964b61981461, server=jenkins-hbase4.apache.org,35469,1689455451912}] 2023-07-15 21:11:36,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-15 21:11:36,587 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 432b04ada69f879ff6e1aaff53543212 2023-07-15 21:11:36,588 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b24331db021a3106148f964b61981461 2023-07-15 21:11:36,588 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 432b04ada69f879ff6e1aaff53543212, disabling compactions & flushes 2023-07-15 21:11:36,588 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b24331db021a3106148f964b61981461, disabling compactions & flushes 2023-07-15 21:11:36,588 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689455480661.432b04ada69f879ff6e1aaff53543212. 2023-07-15 21:11:36,588 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689455480661.b24331db021a3106148f964b61981461. 2023-07-15 21:11:36,588 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689455480661.432b04ada69f879ff6e1aaff53543212. 2023-07-15 21:11:36,588 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689455480661.b24331db021a3106148f964b61981461. 2023-07-15 21:11:36,588 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689455480661.b24331db021a3106148f964b61981461. after waiting 0 ms 2023-07-15 21:11:36,588 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689455480661.b24331db021a3106148f964b61981461. 2023-07-15 21:11:36,588 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689455480661.432b04ada69f879ff6e1aaff53543212. after waiting 0 ms 2023-07-15 21:11:36,588 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689455480661.432b04ada69f879ff6e1aaff53543212. 2023-07-15 21:11:36,602 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemState/432b04ada69f879ff6e1aaff53543212/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 21:11:36,602 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemState/b24331db021a3106148f964b61981461/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 21:11:36,602 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 21:11:36,603 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689455480661.432b04ada69f879ff6e1aaff53543212. 2023-07-15 21:11:36,603 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 432b04ada69f879ff6e1aaff53543212: 2023-07-15 21:11:36,603 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 21:11:36,604 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689455480661.b24331db021a3106148f964b61981461. 2023-07-15 21:11:36,604 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b24331db021a3106148f964b61981461: 2023-07-15 21:11:36,606 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 432b04ada69f879ff6e1aaff53543212 2023-07-15 21:11:36,615 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=432b04ada69f879ff6e1aaff53543212, regionState=CLOSED 2023-07-15 21:11:36,615 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689455480661.432b04ada69f879ff6e1aaff53543212.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689455496615"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689455496615"}]},"ts":"1689455496615"} 2023-07-15 21:11:36,615 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b24331db021a3106148f964b61981461 2023-07-15 21:11:36,616 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=b24331db021a3106148f964b61981461, regionState=CLOSED 2023-07-15 21:11:36,617 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689455480661.b24331db021a3106148f964b61981461.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689455496616"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689455496616"}]},"ts":"1689455496616"} 2023-07-15 21:11:36,622 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=38 2023-07-15 21:11:36,622 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure 432b04ada69f879ff6e1aaff53543212, server=jenkins-hbase4.apache.org,44797,1689455451778 in 184 msec 2023-07-15 21:11:36,623 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=37 2023-07-15 21:11:36,623 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure b24331db021a3106148f964b61981461, server=jenkins-hbase4.apache.org,35469,1689455451912 in 184 msec 2023-07-15 21:11:36,624 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=432b04ada69f879ff6e1aaff53543212, UNASSIGN in 193 msec 2023-07-15 21:11:36,626 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-07-15 21:11:36,626 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b24331db021a3106148f964b61981461, UNASSIGN in 194 msec 2023-07-15 21:11:36,626 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689455496626"}]},"ts":"1689455496626"} 2023-07-15 21:11:36,628 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-15 21:11:36,629 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-15 21:11:36,632 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 211 msec 2023-07-15 21:11:36,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-15 21:11:36,727 INFO [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-15 21:11:36,728 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-15 21:11:36,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-15 21:11:36,731 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-15 21:11:36,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-15 21:11:36,732 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-15 21:11:36,733 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35469] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-15 21:11:36,737 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemState/b24331db021a3106148f964b61981461 2023-07-15 21:11:36,737 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemState/432b04ada69f879ff6e1aaff53543212 2023-07-15 21:11:36,739 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemState/b24331db021a3106148f964b61981461/cf, FileablePath, hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemState/b24331db021a3106148f964b61981461/recovered.edits] 2023-07-15 21:11:36,739 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemState/432b04ada69f879ff6e1aaff53543212/cf, FileablePath, hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemState/432b04ada69f879ff6e1aaff53543212/recovered.edits] 2023-07-15 21:11:36,741 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-15 21:11:36,741 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-15 21:11:36,741 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-15 21:11:36,741 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-15 21:11:36,741 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-15 21:11:36,741 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-15 21:11:36,741 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-15 21:11:36,742 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-15 21:11:36,742 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-15 21:11:36,743 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-15 21:11:36,743 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-15 21:11:36,743 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:11:36,743 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:11:36,743 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-15 21:11:36,743 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:11:36,743 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:11:36,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-15 21:11:36,745 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemState/b24331db021a3106148f964b61981461/cf/1cd862c6326046bf99af26e8db40e246 to hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/archive/data/default/testtb-testExportFileSystemState/b24331db021a3106148f964b61981461/cf/1cd862c6326046bf99af26e8db40e246 2023-07-15 21:11:36,745 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemState/432b04ada69f879ff6e1aaff53543212/cf/22f0caf7964d4b6ba8fa049706237ba2 to hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/archive/data/default/testtb-testExportFileSystemState/432b04ada69f879ff6e1aaff53543212/cf/22f0caf7964d4b6ba8fa049706237ba2 2023-07-15 21:11:36,748 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemState/b24331db021a3106148f964b61981461/recovered.edits/9.seqid to hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/archive/data/default/testtb-testExportFileSystemState/b24331db021a3106148f964b61981461/recovered.edits/9.seqid 2023-07-15 21:11:36,749 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemState/432b04ada69f879ff6e1aaff53543212/recovered.edits/9.seqid to hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/archive/data/default/testtb-testExportFileSystemState/432b04ada69f879ff6e1aaff53543212/recovered.edits/9.seqid 2023-07-15 21:11:36,749 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemState/b24331db021a3106148f964b61981461 2023-07-15 21:11:36,750 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemState/432b04ada69f879ff6e1aaff53543212 2023-07-15 21:11:36,750 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-15 21:11:36,753 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-15 21:11:36,755 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-15 21:11:36,758 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-15 21:11:36,759 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-15 21:11:36,759 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-15 21:11:36,759 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689455480661.b24331db021a3106148f964b61981461.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689455496759"}]},"ts":"9223372036854775807"} 2023-07-15 21:11:36,759 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689455480661.432b04ada69f879ff6e1aaff53543212.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689455496759"}]},"ts":"9223372036854775807"} 2023-07-15 21:11:36,761 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-15 21:11:36,761 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => b24331db021a3106148f964b61981461, NAME => 'testtb-testExportFileSystemState,,1689455480661.b24331db021a3106148f964b61981461.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 432b04ada69f879ff6e1aaff53543212, NAME => 'testtb-testExportFileSystemState,1,1689455480661.432b04ada69f879ff6e1aaff53543212.', STARTKEY => '1', ENDKEY => ''}] 2023-07-15 21:11:36,761 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-15 21:11:36,762 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689455496761"}]},"ts":"9223372036854775807"} 2023-07-15 21:11:36,764 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-15 21:11:36,766 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-15 21:11:36,767 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 38 msec 2023-07-15 21:11:36,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-15 21:11:36,845 INFO [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-15 21:11:36,853 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-15 21:11:36,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:36,857 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-15 21:11:36,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-15 21:11:36,886 INFO [Listener at jenkins-hbase4.apache.org/44607] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=770 (was 756) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1294827490_1 at /127.0.0.1:58268 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_404915474_17 at /127.0.0.1:49276 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1488416207) connection to jenkins-hbase4.apache.org/172.31.14.131:44607 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x7100f96f-shared-pool-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_404915474_17 at /127.0.0.1:43444 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1294827490_1 at /127.0.0.1:43422 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7100f96f-shared-pool-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1488416207) connection to jenkins-hbase4.apache.org/172.31.14.131:39265 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x7100f96f-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1951 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7100f96f-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_404915474_17 at /127.0.0.1:58306 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=927 (was 922) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=317 (was 303) - SystemLoadAverage LEAK? -, ProcessCount=180 (was 180), AvailableMemoryMB=2925 (was 3218) 2023-07-15 21:11:36,887 WARN [Listener at jenkins-hbase4.apache.org/44607] hbase.ResourceChecker(130): Thread=770 is superior to 500 2023-07-15 21:11:36,906 INFO [Listener at jenkins-hbase4.apache.org/44607] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=770, OpenFileDescriptor=927, MaxFileDescriptor=60000, SystemLoadAverage=317, ProcessCount=180, AvailableMemoryMB=2924 2023-07-15 21:11:36,906 WARN [Listener at jenkins-hbase4.apache.org/44607] hbase.ResourceChecker(130): Thread=770 is superior to 500 2023-07-15 21:11:36,908 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-15 21:11:36,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-15 21:11:36,912 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 21:11:36,912 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-15 21:11:36,913 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 21:11:36,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-15 21:11:36,916 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testConsecutiveExports/c868071ce4e1ee89d3276958d0735ade 2023-07-15 21:11:36,916 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testConsecutiveExports/710191a6354626a915b1305d43f1260a 2023-07-15 21:11:36,916 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testConsecutiveExports/c868071ce4e1ee89d3276958d0735ade empty. 2023-07-15 21:11:36,916 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testConsecutiveExports/710191a6354626a915b1305d43f1260a empty. 2023-07-15 21:11:36,917 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testConsecutiveExports/c868071ce4e1ee89d3276958d0735ade 2023-07-15 21:11:36,917 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testConsecutiveExports/710191a6354626a915b1305d43f1260a 2023-07-15 21:11:36,917 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-15 21:11:36,933 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-15 21:11:36,934 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => c868071ce4e1ee89d3276958d0735ade, NAME => 'testtb-testConsecutiveExports,,1689455496908.c868071ce4e1ee89d3276958d0735ade.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp 2023-07-15 21:11:36,934 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 710191a6354626a915b1305d43f1260a, NAME => 'testtb-testConsecutiveExports,1,1689455496908.710191a6354626a915b1305d43f1260a.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp 2023-07-15 21:11:36,953 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689455496908.710191a6354626a915b1305d43f1260a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:11:36,953 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689455496908.c868071ce4e1ee89d3276958d0735ade.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:11:36,954 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 710191a6354626a915b1305d43f1260a, disabling compactions & flushes 2023-07-15 21:11:36,954 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing c868071ce4e1ee89d3276958d0735ade, disabling compactions & flushes 2023-07-15 21:11:36,954 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689455496908.710191a6354626a915b1305d43f1260a. 2023-07-15 21:11:36,954 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689455496908.c868071ce4e1ee89d3276958d0735ade. 2023-07-15 21:11:36,954 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689455496908.710191a6354626a915b1305d43f1260a. 2023-07-15 21:11:36,954 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689455496908.c868071ce4e1ee89d3276958d0735ade. 2023-07-15 21:11:36,954 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689455496908.710191a6354626a915b1305d43f1260a. after waiting 0 ms 2023-07-15 21:11:36,954 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689455496908.c868071ce4e1ee89d3276958d0735ade. after waiting 0 ms 2023-07-15 21:11:36,954 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689455496908.710191a6354626a915b1305d43f1260a. 2023-07-15 21:11:36,954 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689455496908.c868071ce4e1ee89d3276958d0735ade. 2023-07-15 21:11:36,954 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689455496908.710191a6354626a915b1305d43f1260a. 2023-07-15 21:11:36,954 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689455496908.c868071ce4e1ee89d3276958d0735ade. 2023-07-15 21:11:36,954 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 710191a6354626a915b1305d43f1260a: 2023-07-15 21:11:36,954 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for c868071ce4e1ee89d3276958d0735ade: 2023-07-15 21:11:36,957 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 21:11:36,958 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689455496908.710191a6354626a915b1305d43f1260a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689455496958"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689455496958"}]},"ts":"1689455496958"} 2023-07-15 21:11:36,958 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689455496908.c868071ce4e1ee89d3276958d0735ade.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689455496958"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689455496958"}]},"ts":"1689455496958"} 2023-07-15 21:11:36,961 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-15 21:11:36,962 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 21:11:36,962 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689455496962"}]},"ts":"1689455496962"} 2023-07-15 21:11:36,963 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-15 21:11:36,967 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 21:11:36,968 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 21:11:36,968 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 21:11:36,968 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 21:11:36,968 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 21:11:36,968 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c868071ce4e1ee89d3276958d0735ade, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=710191a6354626a915b1305d43f1260a, ASSIGN}] 2023-07-15 21:11:36,972 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c868071ce4e1ee89d3276958d0735ade, ASSIGN 2023-07-15 21:11:36,972 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=710191a6354626a915b1305d43f1260a, ASSIGN 2023-07-15 21:11:36,972 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c868071ce4e1ee89d3276958d0735ade, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44797,1689455451778; forceNewPlan=false, retain=false 2023-07-15 21:11:36,972 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=710191a6354626a915b1305d43f1260a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38601,1689455451863; forceNewPlan=false, retain=false 2023-07-15 21:11:37,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-15 21:11:37,123 INFO [jenkins-hbase4:44929] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-15 21:11:37,125 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=710191a6354626a915b1305d43f1260a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:37,125 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=c868071ce4e1ee89d3276958d0735ade, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:37,126 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689455496908.710191a6354626a915b1305d43f1260a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689455497125"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689455497125"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689455497125"}]},"ts":"1689455497125"} 2023-07-15 21:11:37,126 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689455496908.c868071ce4e1ee89d3276958d0735ade.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689455497125"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689455497125"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689455497125"}]},"ts":"1689455497125"} 2023-07-15 21:11:37,128 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure 710191a6354626a915b1305d43f1260a, server=jenkins-hbase4.apache.org,38601,1689455451863}] 2023-07-15 21:11:37,128 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure c868071ce4e1ee89d3276958d0735ade, server=jenkins-hbase4.apache.org,44797,1689455451778}] 2023-07-15 21:11:37,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-15 21:11:37,292 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689455496908.c868071ce4e1ee89d3276958d0735ade. 2023-07-15 21:11:37,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c868071ce4e1ee89d3276958d0735ade, NAME => 'testtb-testConsecutiveExports,,1689455496908.c868071ce4e1ee89d3276958d0735ade.', STARTKEY => '', ENDKEY => '1'} 2023-07-15 21:11:37,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689455496908.c868071ce4e1ee89d3276958d0735ade. service=AccessControlService 2023-07-15 21:11:37,292 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 21:11:37,293 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports c868071ce4e1ee89d3276958d0735ade 2023-07-15 21:11:37,293 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689455496908.c868071ce4e1ee89d3276958d0735ade.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:11:37,293 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c868071ce4e1ee89d3276958d0735ade 2023-07-15 21:11:37,293 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c868071ce4e1ee89d3276958d0735ade 2023-07-15 21:11:37,293 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689455496908.710191a6354626a915b1305d43f1260a. 2023-07-15 21:11:37,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 710191a6354626a915b1305d43f1260a, NAME => 'testtb-testConsecutiveExports,1,1689455496908.710191a6354626a915b1305d43f1260a.', STARTKEY => '1', ENDKEY => ''} 2023-07-15 21:11:37,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689455496908.710191a6354626a915b1305d43f1260a. service=AccessControlService 2023-07-15 21:11:37,294 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 21:11:37,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 710191a6354626a915b1305d43f1260a 2023-07-15 21:11:37,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689455496908.710191a6354626a915b1305d43f1260a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:11:37,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 710191a6354626a915b1305d43f1260a 2023-07-15 21:11:37,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 710191a6354626a915b1305d43f1260a 2023-07-15 21:11:37,300 INFO [StoreOpener-c868071ce4e1ee89d3276958d0735ade-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c868071ce4e1ee89d3276958d0735ade 2023-07-15 21:11:37,300 INFO [StoreOpener-710191a6354626a915b1305d43f1260a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 710191a6354626a915b1305d43f1260a 2023-07-15 21:11:37,302 DEBUG [StoreOpener-c868071ce4e1ee89d3276958d0735ade-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testConsecutiveExports/c868071ce4e1ee89d3276958d0735ade/cf 2023-07-15 21:11:37,302 DEBUG [StoreOpener-c868071ce4e1ee89d3276958d0735ade-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testConsecutiveExports/c868071ce4e1ee89d3276958d0735ade/cf 2023-07-15 21:11:37,302 INFO [StoreOpener-c868071ce4e1ee89d3276958d0735ade-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c868071ce4e1ee89d3276958d0735ade columnFamilyName cf 2023-07-15 21:11:37,303 INFO [StoreOpener-c868071ce4e1ee89d3276958d0735ade-1] regionserver.HStore(310): Store=c868071ce4e1ee89d3276958d0735ade/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 21:11:37,304 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testConsecutiveExports/c868071ce4e1ee89d3276958d0735ade 2023-07-15 21:11:37,304 DEBUG [StoreOpener-710191a6354626a915b1305d43f1260a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testConsecutiveExports/710191a6354626a915b1305d43f1260a/cf 2023-07-15 21:11:37,304 DEBUG [StoreOpener-710191a6354626a915b1305d43f1260a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testConsecutiveExports/710191a6354626a915b1305d43f1260a/cf 2023-07-15 21:11:37,305 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testConsecutiveExports/c868071ce4e1ee89d3276958d0735ade 2023-07-15 21:11:37,305 INFO [StoreOpener-710191a6354626a915b1305d43f1260a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 710191a6354626a915b1305d43f1260a columnFamilyName cf 2023-07-15 21:11:37,306 INFO [StoreOpener-710191a6354626a915b1305d43f1260a-1] regionserver.HStore(310): Store=710191a6354626a915b1305d43f1260a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 21:11:37,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c868071ce4e1ee89d3276958d0735ade 2023-07-15 21:11:37,311 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testConsecutiveExports/c868071ce4e1ee89d3276958d0735ade/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 21:11:37,312 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c868071ce4e1ee89d3276958d0735ade; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64769871, jitterRate=-0.03485371172428131}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 21:11:37,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c868071ce4e1ee89d3276958d0735ade: 2023-07-15 21:11:37,313 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689455496908.c868071ce4e1ee89d3276958d0735ade., pid=46, masterSystemTime=1689455497281 2023-07-15 21:11:37,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testConsecutiveExports/710191a6354626a915b1305d43f1260a 2023-07-15 21:11:37,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689455496908.c868071ce4e1ee89d3276958d0735ade. 2023-07-15 21:11:37,315 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689455496908.c868071ce4e1ee89d3276958d0735ade. 2023-07-15 21:11:37,316 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=c868071ce4e1ee89d3276958d0735ade, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:37,316 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689455496908.c868071ce4e1ee89d3276958d0735ade.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689455497316"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689455497316"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689455497316"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689455497316"}]},"ts":"1689455497316"} 2023-07-15 21:11:37,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testConsecutiveExports/710191a6354626a915b1305d43f1260a 2023-07-15 21:11:37,320 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=43 2023-07-15 21:11:37,320 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure c868071ce4e1ee89d3276958d0735ade, server=jenkins-hbase4.apache.org,44797,1689455451778 in 190 msec 2023-07-15 21:11:37,322 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c868071ce4e1ee89d3276958d0735ade, ASSIGN in 352 msec 2023-07-15 21:11:37,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 710191a6354626a915b1305d43f1260a 2023-07-15 21:11:37,326 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testConsecutiveExports/710191a6354626a915b1305d43f1260a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 21:11:37,327 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 710191a6354626a915b1305d43f1260a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73275285, jitterRate=0.09188683331012726}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 21:11:37,327 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 710191a6354626a915b1305d43f1260a: 2023-07-15 21:11:37,327 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689455496908.710191a6354626a915b1305d43f1260a., pid=45, masterSystemTime=1689455497280 2023-07-15 21:11:37,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689455496908.710191a6354626a915b1305d43f1260a. 2023-07-15 21:11:37,329 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689455496908.710191a6354626a915b1305d43f1260a. 2023-07-15 21:11:37,329 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=710191a6354626a915b1305d43f1260a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:37,330 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689455496908.710191a6354626a915b1305d43f1260a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689455497329"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689455497329"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689455497329"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689455497329"}]},"ts":"1689455497329"} 2023-07-15 21:11:37,333 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-07-15 21:11:37,333 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure 710191a6354626a915b1305d43f1260a, server=jenkins-hbase4.apache.org,38601,1689455451863 in 203 msec 2023-07-15 21:11:37,335 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=42 2023-07-15 21:11:37,336 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=710191a6354626a915b1305d43f1260a, ASSIGN in 365 msec 2023-07-15 21:11:37,337 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 21:11:37,337 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689455497337"}]},"ts":"1689455497337"} 2023-07-15 21:11:37,338 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-15 21:11:37,341 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 21:11:37,341 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-15 21:11:37,343 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35469] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-15 21:11:37,345 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:11:37,345 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:11:37,345 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:11:37,345 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:11:37,347 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-15 21:11:37,347 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-15 21:11:37,347 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-15 21:11:37,347 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-15 21:11:37,348 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 439 msec 2023-07-15 21:11:37,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-15 21:11:37,517 INFO [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-15 21:11:37,518 DEBUG [Listener at jenkins-hbase4.apache.org/44607] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testConsecutiveExports get assigned. Timeout = 60000ms 2023-07-15 21:11:37,518 INFO [Listener at jenkins-hbase4.apache.org/44607] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 21:11:37,522 INFO [Listener at jenkins-hbase4.apache.org/44607] hbase.HBaseTestingUtility(3484): All regions for table testtb-testConsecutiveExports assigned to meta. Checking AM states. 2023-07-15 21:11:37,522 INFO [Listener at jenkins-hbase4.apache.org/44607] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 21:11:37,522 INFO [Listener at jenkins-hbase4.apache.org/44607] hbase.HBaseTestingUtility(3504): All regions for table testtb-testConsecutiveExports assigned. 2023-07-15 21:11:37,525 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-15 21:11:37,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689455497525 (current time:1689455497525). 2023-07-15 21:11:37,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 21:11:37,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] zookeeper.ReadOnlyZKClient(139): Connect 0x2c4355f3 to 127.0.0.1:57175 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 21:11:37,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@20f12e51, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 21:11:37,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:11:37,538 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54566, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:11:37,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2c4355f3 to 127.0.0.1:57175 2023-07-15 21:11:37,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 21:11:37,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] zookeeper.ReadOnlyZKClient(139): Connect 0x5450f891 to 127.0.0.1:57175 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 21:11:37,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@628ad325, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 21:11:37,555 DEBUG [hconnection-0x4b20fa83-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:11:37,558 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54576, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:11:37,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:11:37,564 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41254, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:11:37,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5450f891 to 127.0.0.1:57175 2023-07-15 21:11:37,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 21:11:37,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-15 21:11:37,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 21:11:37,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-15 21:11:37,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-15 21:11:37,570 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-15 21:11:37,570 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689456097570 2023-07-15 21:11:37,570 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-15 21:11:37,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-15 21:11:37,572 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 21:11:37,572 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 21:11:37,572 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-15 21:11:37,573 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-15 21:11:37,574 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-07-15 21:11:37,575 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-15 21:11:37,576 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689456097576 2023-07-15 21:11:37,599 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:37,599 INFO [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-15 21:11:37,599 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:11:37,600 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-15 21:11:37,600 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-15 21:11:37,600 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:37,600 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:37,602 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:11:37,602 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:37,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:11:37,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:11:37,602 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:11:37,602 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:11:37,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:11:37,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:11:37,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:11:37,603 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:37,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:37,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:11:37,603 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:37,603 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:37,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:37,603 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:37,603 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 21:11:37,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:37,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-15 21:11:37,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:37,604 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:37,604 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:37,604 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-15 21:11:37,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-15 21:11:37,604 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:37,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:37,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-15 21:11:37,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:37,604 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-15 21:11:37,604 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-15 21:11:37,604 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-15 21:11:37,604 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:11:37,606 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-15 21:11:37,606 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-15 21:11:37,606 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38601,1689455451863' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-15 21:11:37,606 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:37,606 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:37,606 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-15 21:11:37,606 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-15 21:11:37,606 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:11:37,606 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:11:37,607 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-15 21:11:37,610 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-15 21:11:37,610 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35469,1689455451912' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-15 21:11:37,610 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-15 21:11:37,610 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-15 21:11:37,610 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44797,1689455451778' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-15 21:11:37,611 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:37,611 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:37,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:37,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:11:37,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:11:37,612 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:37,612 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:37,612 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:37,612 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:37,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:11:37,612 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:11:37,613 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:37,613 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:11:37,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:11:37,613 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:37,613 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:11:37,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:37,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:37,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:37,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:37,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:11:37,614 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38601,1689455451863' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-15 21:11:37,614 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@79ac20c9[Count = 1] remaining members to acquire global barrier 2023-07-15 21:11:37,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:37,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:11:37,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:11:37,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:11:37,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:11:37,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:37,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:37,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:37,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:37,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:11:37,618 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44797,1689455451778' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-15 21:11:37,618 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@79ac20c9[Count = 0] remaining members to acquire global barrier 2023-07-15 21:11:37,618 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-15 21:11:37,618 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:37,620 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:37,620 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:37,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:37,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:37,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:37,620 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-15 21:11:37,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:37,620 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-15 21:11:37,620 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-15 21:11:37,620 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 21:11:37,620 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,35469,1689455451912' in zk 2023-07-15 21:11:37,621 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 21:11:37,621 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689455496908.c868071ce4e1ee89d3276958d0735ade. 2023-07-15 21:11:37,620 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:37,621 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689455496908.c868071ce4e1ee89d3276958d0735ade. started... 2023-07-15 21:11:37,622 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c868071ce4e1ee89d3276958d0735ade: 2023-07-15 21:11:37,623 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:37,623 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 21:11:37,623 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689455496908.c868071ce4e1ee89d3276958d0735ade.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:37,624 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 21:11:37,624 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 21:11:37,625 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:37,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:37,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:37,625 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-15 21:11:37,626 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 21:11:37,626 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 21:11:37,626 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689455496908.710191a6354626a915b1305d43f1260a. 2023-07-15 21:11:37,626 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689455496908.710191a6354626a915b1305d43f1260a. started... 2023-07-15 21:11:37,627 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 710191a6354626a915b1305d43f1260a: 2023-07-15 21:11:37,628 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689455496908.710191a6354626a915b1305d43f1260a.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:37,628 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 21:11:37,628 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 21:11:37,629 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-15 21:11:37,630 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:11:37,630 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-15 21:11:37,667 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689455496908.c868071ce4e1ee89d3276958d0735ade. completed. 2023-07-15 21:11:37,667 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689455496908.c868071ce4e1ee89d3276958d0735ade. 2023-07-15 21:11:37,667 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 21:11:37,667 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 21:11:37,667 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:37,667 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-15 21:11:37,667 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,44797,1689455451778' in zk 2023-07-15 21:11:37,669 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:37,669 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-15 21:11:37,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:37,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:11:37,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:11:37,669 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:11:37,669 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689455496908.710191a6354626a915b1305d43f1260a. completed. 2023-07-15 21:11:37,669 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-15 21:11:37,670 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689455496908.710191a6354626a915b1305d43f1260a. 2023-07-15 21:11:37,670 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 21:11:37,670 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 21:11:37,670 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:37,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:11:37,670 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-15 21:11:37,671 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,38601,1689455451863' in zk 2023-07-15 21:11:37,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:11:37,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:37,672 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 21:11:37,672 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:37,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:37,672 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-15 21:11:37,672 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:11:37,672 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-15 21:11:37,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:37,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-15 21:11:37,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-15 21:11:37,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:37,674 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 21:11:37,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:11:37,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:37,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:37,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:37,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:37,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,44797,1689455451778': 2023-07-15 21:11:37,676 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44797,1689455451778' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-15 21:11:37,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:37,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:11:37,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:11:37,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:11:37,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:11:37,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:37,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:37,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:37,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:37,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:11:37,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:37,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:37,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:37,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:37,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,38601,1689455451863': 2023-07-15 21:11:37,680 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38601,1689455451863' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-15 21:11:37,680 INFO [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-15 21:11:37,680 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 21:11:37,680 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 21:11:37,680 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:37,680 INFO [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 21:11:37,682 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:37,682 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:37,682 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:37,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:37,682 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:37,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:37,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:37,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:37,682 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:11:37,682 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:11:37,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:37,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:11:37,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:11:37,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:11:37,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:11:37,683 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:37,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:37,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:37,682 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:11:37,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:11:37,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:11:37,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:37,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:11:37,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:11:37,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:11:37,684 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:37,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:37,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:37,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:37,684 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:37,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:11:37,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:37,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:37,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:37,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:37,686 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:37,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:11:37,687 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:37,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:37,687 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:37,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:37,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:37,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:37,691 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:37,691 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:37,691 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:37,691 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:37,691 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:11:37,691 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:11:37,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:11:37,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:11:37,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:11:37,691 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:11:37,691 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:11:37,691 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:37,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:11:37,692 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:11:37,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:11:37,692 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:37,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:11:37,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:11:37,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:11:37,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:11:37,692 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:37,692 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:11:37,692 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:37,692 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:11:37,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:11:37,692 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:37,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:11:37,694 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:37,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:11:37,694 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:37,694 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:37,694 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:37,694 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:37,742 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:37,778 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-15 21:11:37,778 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:37,781 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:37,781 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689455497571Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689455497692 (+121 ms)Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689455497692Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689455497699 (+7 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689455497735 (+36 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689455497778 (+43 ms) 2023-07-15 21:11:37,790 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-15 21:11:37,793 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 219 msec 2023-07-15 21:11:37,874 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 21:11:37,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-15 21:11:37,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 21:11:37,883 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44797] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689455496908.c868071ce4e1ee89d3276958d0735ade. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 21:11:37,884 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38601] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689455496908.710191a6354626a915b1305d43f1260a. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 21:11:37,888 DEBUG [Listener at jenkins-hbase4.apache.org/44607] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-15 21:11:37,888 DEBUG [Listener at jenkins-hbase4.apache.org/44607] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689455496908.c868071ce4e1ee89d3276958d0735ade. 2023-07-15 21:11:37,888 INFO [Listener at jenkins-hbase4.apache.org/44607] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 21:11:37,900 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-15 21:11:37,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689455497900 (current time:1689455497900). 2023-07-15 21:11:37,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 21:11:37,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] zookeeper.ReadOnlyZKClient(139): Connect 0x62005416 to 127.0.0.1:57175 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 21:11:37,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2a10eefd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 21:11:37,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:11:37,915 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54590, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:11:37,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x62005416 to 127.0.0.1:57175 2023-07-15 21:11:37,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 21:11:37,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] zookeeper.ReadOnlyZKClient(139): Connect 0x261d30ea to 127.0.0.1:57175 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 21:11:37,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@465d60db, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 21:11:37,924 DEBUG [hconnection-0x6b9709eb-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:11:37,926 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54596, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:11:37,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:11:37,932 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41264, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:11:37,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x261d30ea to 127.0.0.1:57175 2023-07-15 21:11:37,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 21:11:37,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-15 21:11:37,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 21:11:37,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-15 21:11:37,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-15 21:11:37,937 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-15 21:11:37,938 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689456097938 2023-07-15 21:11:37,938 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-15 21:11:37,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-15 21:11:37,940 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 21:11:37,940 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 21:11:37,941 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-15 21:11:37,941 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-15 21:11:37,942 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-07-15 21:11:37,943 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-15 21:11:37,944 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689456097944 2023-07-15 21:11:37,953 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-15 21:11:37,953 INFO [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-15 21:11:37,953 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:11:37,954 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-15 21:11:37,954 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-15 21:11:37,954 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 21:11:37,954 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 21:11:37,956 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:37,956 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:11:37,956 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:11:37,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:11:37,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:11:37,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:11:37,956 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:11:37,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:11:37,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:11:37,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:11:37,956 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:37,956 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:37,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 21:11:37,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 21:11:37,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 21:11:37,957 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:37,957 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 21:11:37,957 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 21:11:37,957 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 21:11:37,957 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 21:11:37,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-15 21:11:37,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-15 21:11:37,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 21:11:37,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 21:11:37,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-15 21:11:37,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 21:11:37,957 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-15 21:11:37,957 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-15 21:11:37,958 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-15 21:11:37,958 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-15 21:11:37,958 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-15 21:11:37,958 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:11:37,959 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-15 21:11:37,959 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-15 21:11:37,959 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38601,1689455451863' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-15 21:11:37,960 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-15 21:11:37,960 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-15 21:11:37,960 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:11:37,961 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-15 21:11:37,961 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-15 21:11:37,961 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-15 21:11:37,961 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-15 21:11:37,961 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35469,1689455451912' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-15 21:11:37,961 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:11:37,962 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-15 21:11:37,962 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-15 21:11:37,962 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44797,1689455451778' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-15 21:11:37,965 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 21:11:37,966 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:37,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:37,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:11:37,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:11:37,966 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 21:11:37,966 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:11:37,967 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 21:11:37,968 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:37,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:11:37,972 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 21:11:37,972 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 21:11:37,972 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:11:37,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:11:37,972 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 21:11:37,972 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:11:37,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 21:11:37,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:37,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:37,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:37,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:11:37,975 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38601,1689455451863' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-15 21:11:37,975 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@8447e4d[Count = 1] remaining members to acquire global barrier 2023-07-15 21:11:37,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:37,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:11:37,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:11:37,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:11:37,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:11:37,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 21:11:37,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:37,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:37,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:37,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:11:37,978 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44797,1689455451778' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-15 21:11:37,978 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@8447e4d[Count = 0] remaining members to acquire global barrier 2023-07-15 21:11:37,978 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-15 21:11:37,978 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 21:11:37,979 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 21:11:37,979 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 21:11:37,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 21:11:37,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 21:11:37,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 21:11:37,979 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 21:11:37,979 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-15 21:11:37,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 21:11:37,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 21:11:37,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 21:11:37,980 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:37,980 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-15 21:11:37,980 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-15 21:11:37,980 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,35469,1689455451912' in zk 2023-07-15 21:11:37,980 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:37,980 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 21:11:37,982 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-15 21:11:37,982 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:11:37,982 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-15 21:11:37,980 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-15 21:11:37,984 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689455496908.c868071ce4e1ee89d3276958d0735ade. 2023-07-15 21:11:37,982 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 21:11:37,984 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 21:11:37,984 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689455496908.c868071ce4e1ee89d3276958d0735ade. started... 2023-07-15 21:11:37,985 INFO [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c868071ce4e1ee89d3276958d0735ade 1/1 column families, dataSize=534 B heapSize=1.38 KB 2023-07-15 21:11:37,986 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 21:11:37,986 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 21:11:37,987 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689455496908.710191a6354626a915b1305d43f1260a. 2023-07-15 21:11:37,987 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689455496908.710191a6354626a915b1305d43f1260a. started... 2023-07-15 21:11:37,987 INFO [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 710191a6354626a915b1305d43f1260a 1/1 column families, dataSize=2.74 KB heapSize=6.16 KB 2023-07-15 21:11:38,014 INFO [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=534 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testConsecutiveExports/c868071ce4e1ee89d3276958d0735ade/.tmp/cf/0eae80b88cfd45c59d08efe531ec543a 2023-07-15 21:11:38,020 INFO [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.74 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testConsecutiveExports/710191a6354626a915b1305d43f1260a/.tmp/cf/822402f21d6b42b7a33515e05a598401 2023-07-15 21:11:38,026 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testConsecutiveExports/c868071ce4e1ee89d3276958d0735ade/.tmp/cf/0eae80b88cfd45c59d08efe531ec543a as hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testConsecutiveExports/c868071ce4e1ee89d3276958d0735ade/cf/0eae80b88cfd45c59d08efe531ec543a 2023-07-15 21:11:38,032 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testConsecutiveExports/710191a6354626a915b1305d43f1260a/.tmp/cf/822402f21d6b42b7a33515e05a598401 as hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testConsecutiveExports/710191a6354626a915b1305d43f1260a/cf/822402f21d6b42b7a33515e05a598401 2023-07-15 21:11:38,034 INFO [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testConsecutiveExports/c868071ce4e1ee89d3276958d0735ade/cf/0eae80b88cfd45c59d08efe531ec543a, entries=8, sequenceid=6, filesize=5.4 K 2023-07-15 21:11:38,035 INFO [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~534 B/534, heapSize ~1.36 KB/1392, currentSize=0 B/0 for c868071ce4e1ee89d3276958d0735ade in 50ms, sequenceid=6, compaction requested=false 2023-07-15 21:11:38,035 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-15 21:11:38,036 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c868071ce4e1ee89d3276958d0735ade: 2023-07-15 21:11:38,036 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689455496908.c868071ce4e1ee89d3276958d0735ade.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-15 21:11:38,036 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 21:11:38,036 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testConsecutiveExports/c868071ce4e1ee89d3276958d0735ade/cf/0eae80b88cfd45c59d08efe531ec543a] hfiles 2023-07-15 21:11:38,036 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testConsecutiveExports/c868071ce4e1ee89d3276958d0735ade/cf/0eae80b88cfd45c59d08efe531ec543a for snapshot=snaptb0-testConsecutiveExports 2023-07-15 21:11:38,039 INFO [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testConsecutiveExports/710191a6354626a915b1305d43f1260a/cf/822402f21d6b42b7a33515e05a598401, entries=42, sequenceid=6, filesize=7.7 K 2023-07-15 21:11:38,040 INFO [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.74 KB/2802, heapSize ~6.14 KB/6288, currentSize=0 B/0 for 710191a6354626a915b1305d43f1260a in 53ms, sequenceid=6, compaction requested=false 2023-07-15 21:11:38,040 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 21:11:38,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-15 21:11:38,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-15 21:11:38,041 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 21:11:38,045 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 710191a6354626a915b1305d43f1260a: 2023-07-15 21:11:38,045 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689455496908.710191a6354626a915b1305d43f1260a.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-15 21:11:38,046 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 21:11:38,046 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testConsecutiveExports/710191a6354626a915b1305d43f1260a/cf/822402f21d6b42b7a33515e05a598401] hfiles 2023-07-15 21:11:38,046 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testConsecutiveExports/710191a6354626a915b1305d43f1260a/cf/822402f21d6b42b7a33515e05a598401 for snapshot=snaptb0-testConsecutiveExports 2023-07-15 21:11:38,052 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689455496908.c868071ce4e1ee89d3276958d0735ade. completed. 2023-07-15 21:11:38,052 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689455496908.c868071ce4e1ee89d3276958d0735ade. 2023-07-15 21:11:38,052 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 21:11:38,052 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 21:11:38,052 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:38,052 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-15 21:11:38,052 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,44797,1689455451778' in zk 2023-07-15 21:11:38,054 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:38,054 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-15 21:11:38,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:38,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:11:38,054 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:11:38,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:11:38,055 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-15 21:11:38,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:11:38,056 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689455496908.710191a6354626a915b1305d43f1260a. completed. 2023-07-15 21:11:38,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:11:38,056 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689455496908.710191a6354626a915b1305d43f1260a. 2023-07-15 21:11:38,057 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 21:11:38,057 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 21:11:38,057 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:38,057 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-15 21:11:38,057 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,38601,1689455451863' in zk 2023-07-15 21:11:38,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 21:11:38,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:38,064 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:38,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:38,064 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-15 21:11:38,064 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:11:38,064 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-15 21:11:38,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:38,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:11:38,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 21:11:38,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:38,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:38,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:38,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,44797,1689455451778': 2023-07-15 21:11:38,067 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44797,1689455451778' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-15 21:11:38,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:38,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:11:38,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:11:38,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:11:38,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:11:38,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 21:11:38,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:38,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:38,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:38,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:11:38,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 21:11:38,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:38,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:38,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:38,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,38601,1689455451863': 2023-07-15 21:11:38,070 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38601,1689455451863' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-15 21:11:38,070 INFO [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-15 21:11:38,070 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 21:11:38,070 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 21:11:38,070 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-15 21:11:38,070 INFO [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 21:11:38,071 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 21:11:38,071 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 21:11:38,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 21:11:38,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:11:38,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:11:38,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 21:11:38,072 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:11:38,071 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 21:11:38,071 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 21:11:38,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 21:11:38,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:11:38,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 21:11:38,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 21:11:38,072 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:11:38,072 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:11:38,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 21:11:38,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 21:11:38,072 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:38,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 21:11:38,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:11:38,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:11:38,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:11:38,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:11:38,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:11:38,073 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:38,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:11:38,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:11:38,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 21:11:38,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 21:11:38,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 21:11:38,073 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:38,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 21:11:38,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:38,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:38,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:38,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:11:38,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 21:11:38,075 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:38,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:38,076 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:38,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:38,076 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:38,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:38,084 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:11:38,084 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:11:38,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:11:38,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:11:38,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:11:38,084 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:11:38,084 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:38,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:11:38,085 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-15 21:11:38,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:11:38,085 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:11:38,085 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:11:38,085 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 21:11:38,085 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:11:38,085 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:11:38,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:11:38,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:11:38,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:11:38,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:11:38,087 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:38,085 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-15 21:11:38,087 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:38,087 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 21:11:38,087 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:11:38,087 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 21:11:38,087 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:11:38,087 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:11:38,087 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 21:11:38,087 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 21:11:38,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:11:38,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:11:38,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:11:38,088 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-15 21:11:38,109 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-15 21:11:38,130 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-15 21:11:38,130 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-15 21:11:38,130 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-15 21:11:38,131 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689455497938Consolidate snapshot: snaptb0-testConsecutiveExports at 1689455498085 (+147 ms)Loading Region manifests for snaptb0-testConsecutiveExports at 1689455498087 (+2 ms)Writing data manifest for snaptb0-testConsecutiveExports at 1689455498091 (+4 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689455498102 (+11 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689455498130 (+28 ms) 2023-07-15 21:11:38,134 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-15 21:11:38,136 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 195 msec 2023-07-15 21:11:38,242 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 21:11:38,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-15 21:11:38,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 21:11:38,243 INFO [Listener at jenkins-hbase4.apache.org/44607] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/local-export-1689455498243 2023-07-15 21:11:38,243 INFO [Listener at jenkins-hbase4.apache.org/44607] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/local-export-1689455498243, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/local-export-1689455498243, srcFsUri=hdfs://localhost:45529, srcDir=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f 2023-07-15 21:11:38,266 DEBUG [Listener at jenkins-hbase4.apache.org/44607] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45529, inputRoot=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f 2023-07-15 21:11:38,266 DEBUG [Listener at jenkins-hbase4.apache.org/44607] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@1d59ec00, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/local-export-1689455498243, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/local-export-1689455498243/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-15 21:11:38,266 INFO [Listener at jenkins-hbase4.apache.org/44607] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45529, inputRoot=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f, snapshotDir=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-15 21:11:38,273 INFO [Listener at jenkins-hbase4.apache.org/44607] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/local-export-1689455498243/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-15 21:11:38,285 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:38,286 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:38,286 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:38,286 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:38,287 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:38,287 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:38,287 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:38,358 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/hadoop-8963294534471372986.jar 2023-07-15 21:11:38,359 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:38,359 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:38,360 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:38,360 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:38,361 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:38,361 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:38,362 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-15 21:11:38,362 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-15 21:11:38,363 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-15 21:11:38,363 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-15 21:11:38,363 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-15 21:11:38,364 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-15 21:11:38,364 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-15 21:11:38,365 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-15 21:11:38,365 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-15 21:11:38,366 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-15 21:11:38,366 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 21:11:38,367 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 21:11:38,367 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 21:11:38,368 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 21:11:38,368 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 21:11:38,369 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 21:11:38,369 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 21:11:39,368 WARN [Listener at jenkins-hbase4.apache.org/44607] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-15 21:11:39,372 INFO [Listener at jenkins-hbase4.apache.org/44607] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-15 21:11:39,374 DEBUG [Listener at jenkins-hbase4.apache.org/44607] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-15 21:11:41,403 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 21:11:41,403 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 21:11:41,406 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689455460014_0002_000001 (auth:SIMPLE) 2023-07-15 21:11:41,611 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689455460014_0003_000001 (auth:SIMPLE) 2023-07-15 21:11:42,187 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-15 21:11:46,133 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689455460014_0003_000001 (auth:SIMPLE) 2023-07-15 21:11:48,367 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689455460014_0003_000001 (auth:SIMPLE) 2023-07-15 21:11:51,738 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689455460014_0003_000001 (auth:SIMPLE) 2023-07-15 21:11:53,605 INFO [Listener at jenkins-hbase4.apache.org/44607] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-15 21:11:53,605 INFO [Listener at jenkins-hbase4.apache.org/44607] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-15 21:11:53,609 INFO [Listener at jenkins-hbase4.apache.org/44607] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-15 21:11:53,609 INFO [Listener at jenkins-hbase4.apache.org/44607] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-15 21:11:53,609 INFO [Listener at jenkins-hbase4.apache.org/44607] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-15 21:11:53,610 DEBUG [Listener at jenkins-hbase4.apache.org/44607] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_404915474_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-15 21:11:53,613 DEBUG [Listener at jenkins-hbase4.apache.org/44607] snapshot.TestExportSnapshot(367): hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-15 21:11:53,613 DEBUG [Listener at jenkins-hbase4.apache.org/44607] snapshot.TestExportSnapshot(367): hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-15 21:11:53,613 DEBUG [Listener at jenkins-hbase4.apache.org/44607] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@56001168 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/local-export-1689455498243/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/local-export-1689455498243/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-15 21:11:53,613 DEBUG [Listener at jenkins-hbase4.apache.org/44607] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/local-export-1689455498243/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-15 21:11:53,613 DEBUG [Listener at jenkins-hbase4.apache.org/44607] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/local-export-1689455498243/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-15 21:11:53,614 INFO [Listener at jenkins-hbase4.apache.org/44607] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/local-export-1689455498243, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/local-export-1689455498243, srcFsUri=hdfs://localhost:45529, srcDir=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f 2023-07-15 21:11:53,636 DEBUG [Listener at jenkins-hbase4.apache.org/44607] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45529, inputRoot=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f 2023-07-15 21:11:53,636 DEBUG [Listener at jenkins-hbase4.apache.org/44607] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@2cfe21db, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/local-export-1689455498243, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/local-export-1689455498243/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-15 21:11:53,636 INFO [Listener at jenkins-hbase4.apache.org/44607] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45529, inputRoot=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f, snapshotDir=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-15 21:11:53,646 INFO [Listener at jenkins-hbase4.apache.org/44607] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/local-export-1689455498243/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-15 21:11:53,657 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:53,658 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:53,658 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:53,658 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:53,659 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:53,659 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:53,659 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:53,733 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/hadoop-3373204043270898611.jar 2023-07-15 21:11:53,734 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:53,735 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:53,735 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:53,735 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:53,736 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:53,736 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:53,736 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-15 21:11:53,737 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-15 21:11:53,737 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-15 21:11:53,737 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-15 21:11:53,738 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-15 21:11:53,738 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-15 21:11:53,738 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-15 21:11:53,739 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-15 21:11:53,739 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-15 21:11:53,739 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-15 21:11:53,740 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 21:11:53,740 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 21:11:53,741 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 21:11:53,741 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 21:11:53,741 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 21:11:53,741 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 21:11:53,742 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 21:11:54,123 WARN [Listener at jenkins-hbase4.apache.org/44607] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-15 21:11:54,125 INFO [Listener at jenkins-hbase4.apache.org/44607] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-15 21:11:54,127 DEBUG [Listener at jenkins-hbase4.apache.org/44607] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-15 21:11:57,912 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 21:11:57,913 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 21:11:57,915 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689455460014_0003_000001 (auth:SIMPLE) 2023-07-15 21:11:58,618 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689455460014_0004_000001 (auth:SIMPLE) 2023-07-15 21:12:03,059 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689455460014_0004_000001 (auth:SIMPLE) 2023-07-15 21:12:05,278 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689455460014_0004_000001 (auth:SIMPLE) 2023-07-15 21:12:07,896 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689455460014_0004_000001 (auth:SIMPLE) 2023-07-15 21:12:09,316 INFO [Listener at jenkins-hbase4.apache.org/44607] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-15 21:12:09,316 INFO [Listener at jenkins-hbase4.apache.org/44607] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-15 21:12:09,320 INFO [Listener at jenkins-hbase4.apache.org/44607] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-15 21:12:09,320 INFO [Listener at jenkins-hbase4.apache.org/44607] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-15 21:12:09,321 INFO [Listener at jenkins-hbase4.apache.org/44607] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-15 21:12:09,321 DEBUG [Listener at jenkins-hbase4.apache.org/44607] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_404915474_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-15 21:12:09,326 DEBUG [Listener at jenkins-hbase4.apache.org/44607] snapshot.TestExportSnapshot(367): hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-15 21:12:09,326 DEBUG [Listener at jenkins-hbase4.apache.org/44607] snapshot.TestExportSnapshot(367): hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-15 21:12:09,326 DEBUG [Listener at jenkins-hbase4.apache.org/44607] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@56001168 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/local-export-1689455498243/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/local-export-1689455498243/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-15 21:12:09,326 DEBUG [Listener at jenkins-hbase4.apache.org/44607] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/local-export-1689455498243/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-15 21:12:09,326 DEBUG [Listener at jenkins-hbase4.apache.org/44607] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/local-export-1689455498243/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-15 21:12:09,339 INFO [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-15 21:12:09,339 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-15 21:12:09,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-15 21:12:09,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-15 21:12:09,345 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689455529345"}]},"ts":"1689455529345"} 2023-07-15 21:12:09,347 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-15 21:12:09,348 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-15 21:12:09,349 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c868071ce4e1ee89d3276958d0735ade, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=710191a6354626a915b1305d43f1260a, UNASSIGN}] 2023-07-15 21:12:09,352 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c868071ce4e1ee89d3276958d0735ade, UNASSIGN 2023-07-15 21:12:09,352 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=710191a6354626a915b1305d43f1260a, UNASSIGN 2023-07-15 21:12:09,357 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=c868071ce4e1ee89d3276958d0735ade, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:09,357 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689455496908.c868071ce4e1ee89d3276958d0735ade.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689455529357"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689455529357"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689455529357"}]},"ts":"1689455529357"} 2023-07-15 21:12:09,358 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=710191a6354626a915b1305d43f1260a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:09,358 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689455496908.710191a6354626a915b1305d43f1260a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689455529358"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689455529358"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689455529358"}]},"ts":"1689455529358"} 2023-07-15 21:12:09,361 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure c868071ce4e1ee89d3276958d0735ade, server=jenkins-hbase4.apache.org,44797,1689455451778}] 2023-07-15 21:12:09,362 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure 710191a6354626a915b1305d43f1260a, server=jenkins-hbase4.apache.org,38601,1689455451863}] 2023-07-15 21:12:09,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-15 21:12:09,515 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c868071ce4e1ee89d3276958d0735ade 2023-07-15 21:12:09,515 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c868071ce4e1ee89d3276958d0735ade, disabling compactions & flushes 2023-07-15 21:12:09,515 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689455496908.c868071ce4e1ee89d3276958d0735ade. 2023-07-15 21:12:09,515 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689455496908.c868071ce4e1ee89d3276958d0735ade. 2023-07-15 21:12:09,515 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689455496908.c868071ce4e1ee89d3276958d0735ade. after waiting 0 ms 2023-07-15 21:12:09,515 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689455496908.c868071ce4e1ee89d3276958d0735ade. 2023-07-15 21:12:09,515 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 710191a6354626a915b1305d43f1260a 2023-07-15 21:12:09,515 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 710191a6354626a915b1305d43f1260a, disabling compactions & flushes 2023-07-15 21:12:09,515 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689455496908.710191a6354626a915b1305d43f1260a. 2023-07-15 21:12:09,515 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689455496908.710191a6354626a915b1305d43f1260a. 2023-07-15 21:12:09,516 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689455496908.710191a6354626a915b1305d43f1260a. after waiting 0 ms 2023-07-15 21:12:09,516 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689455496908.710191a6354626a915b1305d43f1260a. 2023-07-15 21:12:09,579 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testConsecutiveExports/710191a6354626a915b1305d43f1260a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 21:12:09,579 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testConsecutiveExports/c868071ce4e1ee89d3276958d0735ade/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 21:12:09,580 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 21:12:09,580 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 21:12:09,581 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689455496908.710191a6354626a915b1305d43f1260a. 2023-07-15 21:12:09,581 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689455496908.c868071ce4e1ee89d3276958d0735ade. 2023-07-15 21:12:09,581 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 710191a6354626a915b1305d43f1260a: 2023-07-15 21:12:09,582 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c868071ce4e1ee89d3276958d0735ade: 2023-07-15 21:12:09,583 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 710191a6354626a915b1305d43f1260a 2023-07-15 21:12:09,584 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=710191a6354626a915b1305d43f1260a, regionState=CLOSED 2023-07-15 21:12:09,584 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689455496908.710191a6354626a915b1305d43f1260a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689455529584"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689455529584"}]},"ts":"1689455529584"} 2023-07-15 21:12:09,584 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c868071ce4e1ee89d3276958d0735ade 2023-07-15 21:12:09,585 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=c868071ce4e1ee89d3276958d0735ade, regionState=CLOSED 2023-07-15 21:12:09,585 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689455496908.c868071ce4e1ee89d3276958d0735ade.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689455529585"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689455529585"}]},"ts":"1689455529585"} 2023-07-15 21:12:09,587 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=53 2023-07-15 21:12:09,587 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure 710191a6354626a915b1305d43f1260a, server=jenkins-hbase4.apache.org,38601,1689455451863 in 224 msec 2023-07-15 21:12:09,588 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=52 2023-07-15 21:12:09,589 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure c868071ce4e1ee89d3276958d0735ade, server=jenkins-hbase4.apache.org,44797,1689455451778 in 225 msec 2023-07-15 21:12:09,589 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=710191a6354626a915b1305d43f1260a, UNASSIGN in 238 msec 2023-07-15 21:12:09,590 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-07-15 21:12:09,590 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c868071ce4e1ee89d3276958d0735ade, UNASSIGN in 240 msec 2023-07-15 21:12:09,591 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689455529591"}]},"ts":"1689455529591"} 2023-07-15 21:12:09,592 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-15 21:12:09,594 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-15 21:12:09,596 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 256 msec 2023-07-15 21:12:09,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-15 21:12:09,647 INFO [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-15 21:12:09,648 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-15 21:12:09,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-15 21:12:09,651 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-15 21:12:09,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-15 21:12:09,652 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-15 21:12:09,654 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35469] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-15 21:12:09,658 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testConsecutiveExports/c868071ce4e1ee89d3276958d0735ade 2023-07-15 21:12:09,658 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testConsecutiveExports/710191a6354626a915b1305d43f1260a 2023-07-15 21:12:09,658 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-15 21:12:09,658 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-15 21:12:09,658 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-15 21:12:09,658 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-15 21:12:09,659 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-15 21:12:09,659 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-15 21:12:09,659 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-15 21:12:09,660 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-15 21:12:09,660 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:12:09,660 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-15 21:12:09,660 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:12:09,660 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-15 21:12:09,660 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:12:09,660 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:12:09,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-15 21:12:09,662 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data null 2023-07-15 21:12:09,662 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-15 21:12:09,663 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testConsecutiveExports/c868071ce4e1ee89d3276958d0735ade/cf, FileablePath, hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testConsecutiveExports/c868071ce4e1ee89d3276958d0735ade/recovered.edits] 2023-07-15 21:12:09,663 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testConsecutiveExports/710191a6354626a915b1305d43f1260a/cf, FileablePath, hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testConsecutiveExports/710191a6354626a915b1305d43f1260a/recovered.edits] 2023-07-15 21:12:09,667 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testConsecutiveExports/c868071ce4e1ee89d3276958d0735ade/cf/0eae80b88cfd45c59d08efe531ec543a to hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/archive/data/default/testtb-testConsecutiveExports/c868071ce4e1ee89d3276958d0735ade/cf/0eae80b88cfd45c59d08efe531ec543a 2023-07-15 21:12:09,667 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testConsecutiveExports/710191a6354626a915b1305d43f1260a/cf/822402f21d6b42b7a33515e05a598401 to hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/archive/data/default/testtb-testConsecutiveExports/710191a6354626a915b1305d43f1260a/cf/822402f21d6b42b7a33515e05a598401 2023-07-15 21:12:09,670 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testConsecutiveExports/c868071ce4e1ee89d3276958d0735ade/recovered.edits/9.seqid to hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/archive/data/default/testtb-testConsecutiveExports/c868071ce4e1ee89d3276958d0735ade/recovered.edits/9.seqid 2023-07-15 21:12:09,670 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testConsecutiveExports/710191a6354626a915b1305d43f1260a/recovered.edits/9.seqid to hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/archive/data/default/testtb-testConsecutiveExports/710191a6354626a915b1305d43f1260a/recovered.edits/9.seqid 2023-07-15 21:12:09,671 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testConsecutiveExports/c868071ce4e1ee89d3276958d0735ade 2023-07-15 21:12:09,671 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testConsecutiveExports/710191a6354626a915b1305d43f1260a 2023-07-15 21:12:09,671 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-15 21:12:09,673 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-15 21:12:09,676 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-15 21:12:09,677 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-15 21:12:09,679 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-15 21:12:09,679 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-15 21:12:09,679 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689455496908.c868071ce4e1ee89d3276958d0735ade.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689455529679"}]},"ts":"9223372036854775807"} 2023-07-15 21:12:09,679 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689455496908.710191a6354626a915b1305d43f1260a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689455529679"}]},"ts":"9223372036854775807"} 2023-07-15 21:12:09,680 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-15 21:12:09,681 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => c868071ce4e1ee89d3276958d0735ade, NAME => 'testtb-testConsecutiveExports,,1689455496908.c868071ce4e1ee89d3276958d0735ade.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 710191a6354626a915b1305d43f1260a, NAME => 'testtb-testConsecutiveExports,1,1689455496908.710191a6354626a915b1305d43f1260a.', STARTKEY => '1', ENDKEY => ''}] 2023-07-15 21:12:09,681 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-15 21:12:09,681 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689455529681"}]},"ts":"9223372036854775807"} 2023-07-15 21:12:09,682 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-15 21:12:09,684 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-15 21:12:09,685 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 36 msec 2023-07-15 21:12:09,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-15 21:12:09,763 INFO [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-15 21:12:09,770 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-15 21:12:09,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-15 21:12:09,773 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-15 21:12:09,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-15 21:12:09,800 INFO [Listener at jenkins-hbase4.apache.org/44607] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=749 (was 770), OpenFileDescriptor=902 (was 927), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=362 (was 317) - SystemLoadAverage LEAK? -, ProcessCount=178 (was 180), AvailableMemoryMB=3645 (was 2924) - AvailableMemoryMB LEAK? - 2023-07-15 21:12:09,800 WARN [Listener at jenkins-hbase4.apache.org/44607] hbase.ResourceChecker(130): Thread=749 is superior to 500 2023-07-15 21:12:09,821 INFO [Listener at jenkins-hbase4.apache.org/44607] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=749, OpenFileDescriptor=902, MaxFileDescriptor=60000, SystemLoadAverage=362, ProcessCount=178, AvailableMemoryMB=3643 2023-07-15 21:12:09,821 WARN [Listener at jenkins-hbase4.apache.org/44607] hbase.ResourceChecker(130): Thread=749 is superior to 500 2023-07-15 21:12:09,823 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-15 21:12:09,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:09,833 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 21:12:09,833 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-15 21:12:09,834 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 21:12:09,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-15 21:12:09,836 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3e988182b6c4d37d28697476ab4ffb83 2023-07-15 21:12:09,837 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8fe03472607d0be07f8d2b650875e7fe 2023-07-15 21:12:09,837 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3e988182b6c4d37d28697476ab4ffb83 empty. 2023-07-15 21:12:09,837 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8fe03472607d0be07f8d2b650875e7fe empty. 2023-07-15 21:12:09,838 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3e988182b6c4d37d28697476ab4ffb83 2023-07-15 21:12:09,838 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8fe03472607d0be07f8d2b650875e7fe 2023-07-15 21:12:09,838 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-15 21:12:09,848 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-15 21:12:09,850 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 8fe03472607d0be07f8d2b650875e7fe, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689455529822.8fe03472607d0be07f8d2b650875e7fe.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp 2023-07-15 21:12:09,850 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 3e988182b6c4d37d28697476ab4ffb83, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689455529822.3e988182b6c4d37d28697476ab4ffb83.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp 2023-07-15 21:12:09,870 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689455529822.3e988182b6c4d37d28697476ab4ffb83.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:12:09,870 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 3e988182b6c4d37d28697476ab4ffb83, disabling compactions & flushes 2023-07-15 21:12:09,870 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689455529822.3e988182b6c4d37d28697476ab4ffb83. 2023-07-15 21:12:09,870 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689455529822.3e988182b6c4d37d28697476ab4ffb83. 2023-07-15 21:12:09,870 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689455529822.3e988182b6c4d37d28697476ab4ffb83. after waiting 0 ms 2023-07-15 21:12:09,870 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689455529822.3e988182b6c4d37d28697476ab4ffb83. 2023-07-15 21:12:09,870 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689455529822.3e988182b6c4d37d28697476ab4ffb83. 2023-07-15 21:12:09,870 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 3e988182b6c4d37d28697476ab4ffb83: 2023-07-15 21:12:09,871 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689455529822.8fe03472607d0be07f8d2b650875e7fe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:12:09,871 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 8fe03472607d0be07f8d2b650875e7fe, disabling compactions & flushes 2023-07-15 21:12:09,871 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689455529822.8fe03472607d0be07f8d2b650875e7fe. 2023-07-15 21:12:09,871 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689455529822.8fe03472607d0be07f8d2b650875e7fe. 2023-07-15 21:12:09,871 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689455529822.8fe03472607d0be07f8d2b650875e7fe. after waiting 0 ms 2023-07-15 21:12:09,871 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689455529822.8fe03472607d0be07f8d2b650875e7fe. 2023-07-15 21:12:09,871 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689455529822.8fe03472607d0be07f8d2b650875e7fe. 2023-07-15 21:12:09,871 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 8fe03472607d0be07f8d2b650875e7fe: 2023-07-15 21:12:09,874 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 21:12:09,875 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689455529822.3e988182b6c4d37d28697476ab4ffb83.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689455529875"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689455529875"}]},"ts":"1689455529875"} 2023-07-15 21:12:09,875 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689455529822.8fe03472607d0be07f8d2b650875e7fe.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689455529875"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689455529875"}]},"ts":"1689455529875"} 2023-07-15 21:12:09,880 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-15 21:12:09,882 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 21:12:09,882 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689455529882"}]},"ts":"1689455529882"} 2023-07-15 21:12:09,883 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-15 21:12:09,887 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 21:12:09,888 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 21:12:09,889 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 21:12:09,889 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 21:12:09,889 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 21:12:09,889 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=3e988182b6c4d37d28697476ab4ffb83, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=8fe03472607d0be07f8d2b650875e7fe, ASSIGN}] 2023-07-15 21:12:09,891 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=8fe03472607d0be07f8d2b650875e7fe, ASSIGN 2023-07-15 21:12:09,891 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=3e988182b6c4d37d28697476ab4ffb83, ASSIGN 2023-07-15 21:12:09,892 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=8fe03472607d0be07f8d2b650875e7fe, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44797,1689455451778; forceNewPlan=false, retain=false 2023-07-15 21:12:09,892 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=3e988182b6c4d37d28697476ab4ffb83, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38601,1689455451863; forceNewPlan=false, retain=false 2023-07-15 21:12:09,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-15 21:12:10,042 INFO [jenkins-hbase4:44929] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-15 21:12:10,045 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=8fe03472607d0be07f8d2b650875e7fe, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:10,045 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=3e988182b6c4d37d28697476ab4ffb83, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:10,045 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689455529822.8fe03472607d0be07f8d2b650875e7fe.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689455530045"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689455530045"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689455530045"}]},"ts":"1689455530045"} 2023-07-15 21:12:10,045 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689455529822.3e988182b6c4d37d28697476ab4ffb83.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689455530045"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689455530045"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689455530045"}]},"ts":"1689455530045"} 2023-07-15 21:12:10,047 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure 8fe03472607d0be07f8d2b650875e7fe, server=jenkins-hbase4.apache.org,44797,1689455451778}] 2023-07-15 21:12:10,048 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure 3e988182b6c4d37d28697476ab4ffb83, server=jenkins-hbase4.apache.org,38601,1689455451863}] 2023-07-15 21:12:10,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-15 21:12:10,201 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689455529822.8fe03472607d0be07f8d2b650875e7fe. 2023-07-15 21:12:10,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8fe03472607d0be07f8d2b650875e7fe, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689455529822.8fe03472607d0be07f8d2b650875e7fe.', STARTKEY => '1', ENDKEY => ''} 2023-07-15 21:12:10,202 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689455529822.8fe03472607d0be07f8d2b650875e7fe. service=AccessControlService 2023-07-15 21:12:10,202 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 21:12:10,202 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689455529822.3e988182b6c4d37d28697476ab4ffb83. 2023-07-15 21:12:10,202 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 8fe03472607d0be07f8d2b650875e7fe 2023-07-15 21:12:10,202 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3e988182b6c4d37d28697476ab4ffb83, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689455529822.3e988182b6c4d37d28697476ab4ffb83.', STARTKEY => '', ENDKEY => '1'} 2023-07-15 21:12:10,202 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689455529822.8fe03472607d0be07f8d2b650875e7fe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:12:10,202 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8fe03472607d0be07f8d2b650875e7fe 2023-07-15 21:12:10,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8fe03472607d0be07f8d2b650875e7fe 2023-07-15 21:12:10,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689455529822.3e988182b6c4d37d28697476ab4ffb83. service=AccessControlService 2023-07-15 21:12:10,203 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 21:12:10,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 3e988182b6c4d37d28697476ab4ffb83 2023-07-15 21:12:10,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689455529822.3e988182b6c4d37d28697476ab4ffb83.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:12:10,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3e988182b6c4d37d28697476ab4ffb83 2023-07-15 21:12:10,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3e988182b6c4d37d28697476ab4ffb83 2023-07-15 21:12:10,204 INFO [StoreOpener-8fe03472607d0be07f8d2b650875e7fe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8fe03472607d0be07f8d2b650875e7fe 2023-07-15 21:12:10,204 INFO [StoreOpener-3e988182b6c4d37d28697476ab4ffb83-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 3e988182b6c4d37d28697476ab4ffb83 2023-07-15 21:12:10,206 DEBUG [StoreOpener-8fe03472607d0be07f8d2b650875e7fe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithMergeRegion/8fe03472607d0be07f8d2b650875e7fe/cf 2023-07-15 21:12:10,206 DEBUG [StoreOpener-3e988182b6c4d37d28697476ab4ffb83-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithMergeRegion/3e988182b6c4d37d28697476ab4ffb83/cf 2023-07-15 21:12:10,206 DEBUG [StoreOpener-3e988182b6c4d37d28697476ab4ffb83-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithMergeRegion/3e988182b6c4d37d28697476ab4ffb83/cf 2023-07-15 21:12:10,206 DEBUG [StoreOpener-8fe03472607d0be07f8d2b650875e7fe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithMergeRegion/8fe03472607d0be07f8d2b650875e7fe/cf 2023-07-15 21:12:10,207 INFO [StoreOpener-3e988182b6c4d37d28697476ab4ffb83-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3e988182b6c4d37d28697476ab4ffb83 columnFamilyName cf 2023-07-15 21:12:10,207 INFO [StoreOpener-8fe03472607d0be07f8d2b650875e7fe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8fe03472607d0be07f8d2b650875e7fe columnFamilyName cf 2023-07-15 21:12:10,208 INFO [StoreOpener-8fe03472607d0be07f8d2b650875e7fe-1] regionserver.HStore(310): Store=8fe03472607d0be07f8d2b650875e7fe/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 21:12:10,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithMergeRegion/8fe03472607d0be07f8d2b650875e7fe 2023-07-15 21:12:10,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithMergeRegion/8fe03472607d0be07f8d2b650875e7fe 2023-07-15 21:12:10,211 INFO [StoreOpener-3e988182b6c4d37d28697476ab4ffb83-1] regionserver.HStore(310): Store=3e988182b6c4d37d28697476ab4ffb83/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 21:12:10,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8fe03472607d0be07f8d2b650875e7fe 2023-07-15 21:12:10,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithMergeRegion/3e988182b6c4d37d28697476ab4ffb83 2023-07-15 21:12:10,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithMergeRegion/3e988182b6c4d37d28697476ab4ffb83 2023-07-15 21:12:10,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithMergeRegion/8fe03472607d0be07f8d2b650875e7fe/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 21:12:10,216 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8fe03472607d0be07f8d2b650875e7fe; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60113032, jitterRate=-0.10424602031707764}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 21:12:10,216 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8fe03472607d0be07f8d2b650875e7fe: 2023-07-15 21:12:10,217 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689455529822.8fe03472607d0be07f8d2b650875e7fe., pid=60, masterSystemTime=1689455530198 2023-07-15 21:12:10,219 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3e988182b6c4d37d28697476ab4ffb83 2023-07-15 21:12:10,219 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689455529822.8fe03472607d0be07f8d2b650875e7fe. 2023-07-15 21:12:10,219 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689455529822.8fe03472607d0be07f8d2b650875e7fe. 2023-07-15 21:12:10,220 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=8fe03472607d0be07f8d2b650875e7fe, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:10,220 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689455529822.8fe03472607d0be07f8d2b650875e7fe.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689455530220"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689455530220"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689455530220"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689455530220"}]},"ts":"1689455530220"} 2023-07-15 21:12:10,221 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithMergeRegion/3e988182b6c4d37d28697476ab4ffb83/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 21:12:10,222 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3e988182b6c4d37d28697476ab4ffb83; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64859497, jitterRate=-0.03351818025112152}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 21:12:10,222 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3e988182b6c4d37d28697476ab4ffb83: 2023-07-15 21:12:10,223 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689455529822.3e988182b6c4d37d28697476ab4ffb83., pid=61, masterSystemTime=1689455530199 2023-07-15 21:12:10,225 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689455529822.3e988182b6c4d37d28697476ab4ffb83. 2023-07-15 21:12:10,225 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-07-15 21:12:10,226 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689455529822.3e988182b6c4d37d28697476ab4ffb83. 2023-07-15 21:12:10,226 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure 8fe03472607d0be07f8d2b650875e7fe, server=jenkins-hbase4.apache.org,44797,1689455451778 in 175 msec 2023-07-15 21:12:10,226 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=3e988182b6c4d37d28697476ab4ffb83, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:10,226 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689455529822.3e988182b6c4d37d28697476ab4ffb83.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689455530226"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689455530226"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689455530226"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689455530226"}]},"ts":"1689455530226"} 2023-07-15 21:12:10,227 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=8fe03472607d0be07f8d2b650875e7fe, ASSIGN in 336 msec 2023-07-15 21:12:10,229 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=58 2023-07-15 21:12:10,230 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure 3e988182b6c4d37d28697476ab4ffb83, server=jenkins-hbase4.apache.org,38601,1689455451863 in 180 msec 2023-07-15 21:12:10,231 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=58, resume processing ppid=57 2023-07-15 21:12:10,231 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=3e988182b6c4d37d28697476ab4ffb83, ASSIGN in 341 msec 2023-07-15 21:12:10,232 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 21:12:10,232 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689455530232"}]},"ts":"1689455530232"} 2023-07-15 21:12:10,233 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-15 21:12:10,236 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 21:12:10,236 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-15 21:12:10,238 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35469] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-15 21:12:10,239 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:12:10,239 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:12:10,239 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:12:10,239 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:12:10,241 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 21:12:10,241 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 21:12:10,241 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 21:12:10,241 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 21:12:10,243 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 418 msec 2023-07-15 21:12:10,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-15 21:12:10,438 INFO [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-15 21:12:10,438 DEBUG [Listener at jenkins-hbase4.apache.org/44607] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithMergeRegion get assigned. Timeout = 60000ms 2023-07-15 21:12:10,438 INFO [Listener at jenkins-hbase4.apache.org/44607] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 21:12:10,441 INFO [Listener at jenkins-hbase4.apache.org/44607] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned to meta. Checking AM states. 2023-07-15 21:12:10,441 INFO [Listener at jenkins-hbase4.apache.org/44607] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 21:12:10,442 INFO [Listener at jenkins-hbase4.apache.org/44607] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned. 2023-07-15 21:12:10,445 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-15 21:12:10,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689455530445 (current time:1689455530445). 2023-07-15 21:12:10,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 21:12:10,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] zookeeper.ReadOnlyZKClient(139): Connect 0x6d716ebc to 127.0.0.1:57175 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 21:12:10,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@29ebfa4c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 21:12:10,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:12:10,456 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55404, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:12:10,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6d716ebc to 127.0.0.1:57175 2023-07-15 21:12:10,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 21:12:10,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] zookeeper.ReadOnlyZKClient(139): Connect 0x761139c3 to 127.0.0.1:57175 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 21:12:10,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@10f3bd33, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 21:12:10,464 DEBUG [hconnection-0x66bc0cfb-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:12:10,466 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55410, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:12:10,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:12:10,473 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51220, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:12:10,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x761139c3 to 127.0.0.1:57175 2023-07-15 21:12:10,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 21:12:10,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-15 21:12:10,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 21:12:10,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-15 21:12:10,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-15 21:12:10,478 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-15 21:12:10,479 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689456130479 2023-07-15 21:12:10,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-15 21:12:10,479 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,481 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 21:12:10,481 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 21:12:10,482 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-15 21:12:10,482 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-15 21:12:10,483 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 6 msec 2023-07-15 21:12:10,484 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-15 21:12:10,484 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689456130484 2023-07-15 21:12:10,494 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,494 INFO [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-15 21:12:10,494 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:12:10,495 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-15 21:12:10,495 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-15 21:12:10,496 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,496 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,498 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:10,498 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:10,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:10,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:10,498 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:10,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:10,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:10,498 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:10,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:10,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:10,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,499 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:10,499 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,499 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:10,500 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,500 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-15 21:12:10,500 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:10,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-15 21:12:10,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-15 21:12:10,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,500 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-15 21:12:10,500 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-15 21:12:10,500 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 21:12:10,500 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-15 21:12:10,501 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,501 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,501 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-15 21:12:10,501 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-15 21:12:10,501 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:12:10,501 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,503 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-15 21:12:10,503 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-15 21:12:10,503 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:12:10,501 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:12:10,504 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-15 21:12:10,505 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-15 21:12:10,505 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-15 21:12:10,503 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-15 21:12:10,505 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38601,1689455451863' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-15 21:12:10,505 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-15 21:12:10,505 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44797,1689455451778' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-15 21:12:10,505 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35469,1689455451912' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-15 21:12:10,507 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,507 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,507 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,507 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:10,507 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:10,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:10,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:12:10,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:12:10,508 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,508 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:12:10,508 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,508 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:12:10,508 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:12:10,508 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:12:10,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:12:10,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:10,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:10,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:10,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:12:10,510 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44797,1689455451778' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-15 21:12:10,510 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@62e9d843[Count = 1] remaining members to acquire global barrier 2023-07-15 21:12:10,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:10,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:12:10,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:12:10,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:12:10,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:12:10,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:10,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:10,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:10,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:12:10,512 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38601,1689455451863' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-15 21:12:10,513 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@62e9d843[Count = 0] remaining members to acquire global barrier 2023-07-15 21:12:10,513 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-15 21:12:10,513 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,514 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,514 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,514 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,514 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:10,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,514 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-15 21:12:10,514 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-15 21:12:10,514 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:10,514 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 21:12:10,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,514 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 21:12:10,514 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689455529822.3e988182b6c4d37d28697476ab4ffb83. 2023-07-15 21:12:10,515 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 21:12:10,515 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689455529822.3e988182b6c4d37d28697476ab4ffb83. started... 2023-07-15 21:12:10,515 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689455529822.8fe03472607d0be07f8d2b650875e7fe. 2023-07-15 21:12:10,515 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 21:12:10,515 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 21:12:10,516 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3e988182b6c4d37d28697476ab4ffb83: 2023-07-15 21:12:10,514 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-15 21:12:10,515 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689455529822.8fe03472607d0be07f8d2b650875e7fe. started... 2023-07-15 21:12:10,516 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-15 21:12:10,516 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,35469,1689455451912' in zk 2023-07-15 21:12:10,516 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689455529822.3e988182b6c4d37d28697476ab4ffb83.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,517 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 21:12:10,517 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8fe03472607d0be07f8d2b650875e7fe: 2023-07-15 21:12:10,517 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 21:12:10,517 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689455529822.8fe03472607d0be07f8d2b650875e7fe.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,517 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 21:12:10,517 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 21:12:10,527 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-15 21:12:10,527 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:12:10,527 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-15 21:12:10,541 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689455529822.3e988182b6c4d37d28697476ab4ffb83. completed. 2023-07-15 21:12:10,541 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689455529822.3e988182b6c4d37d28697476ab4ffb83. 2023-07-15 21:12:10,541 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 21:12:10,542 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 21:12:10,542 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:10,542 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-15 21:12:10,542 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,38601,1689455451863' in zk 2023-07-15 21:12:10,544 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-15 21:12:10,544 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:10,544 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:12:10,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:10,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:12:10,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:12:10,544 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-15 21:12:10,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:12:10,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:12:10,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:10,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:10,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:10,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:12:10,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,549 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689455529822.8fe03472607d0be07f8d2b650875e7fe. completed. 2023-07-15 21:12:10,549 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689455529822.8fe03472607d0be07f8d2b650875e7fe. 2023-07-15 21:12:10,550 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 21:12:10,550 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 21:12:10,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:10,550 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:10,550 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-15 21:12:10,550 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,44797,1689455451778' in zk 2023-07-15 21:12:10,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:10,552 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:10,552 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-15 21:12:10,552 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:12:10,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,38601,1689455451863': 2023-07-15 21:12:10,552 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-15 21:12:10,553 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38601,1689455451863' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-15 21:12:10,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:10,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:12:10,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:12:10,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:12:10,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:12:10,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:10,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:10,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:10,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:12:10,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:10,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:10,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:10,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,44797,1689455451778': 2023-07-15 21:12:10,557 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44797,1689455451778' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-15 21:12:10,557 INFO [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-15 21:12:10,557 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 21:12:10,557 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 21:12:10,557 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,557 INFO [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 21:12:10,559 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,559 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,559 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,559 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:10,559 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:12:10,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:12:10,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,559 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:10,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:10,559 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:10,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:10,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,561 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:10,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:12:10,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:10,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:10,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:10,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:10,561 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:10,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,562 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:10,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:12:10,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:10,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:10,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:10,564 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:10,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:12:10,564 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:10,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,564 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:10,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:10,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:10,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:10,568 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:10,568 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:10,568 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,568 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:10,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:10,568 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:10,568 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:10,568 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:10,568 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:12:10,568 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:10,568 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:10,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:10,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:10,568 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:10,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:10,568 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:10,568 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:10,570 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,570 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:10,570 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:10,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:10,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:10,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:10,570 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:10,570 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,571 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:10,571 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:10,571 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,571 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:10,571 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,581 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 21:12:10,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-15 21:12:10,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-15 21:12:10,582 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 21:12:10,595 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,618 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-15 21:12:10,618 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,619 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,619 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689455530480Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689455530570 (+90 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689455530570Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689455530575 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689455530588 (+13 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689455530618 (+30 ms) 2023-07-15 21:12:10,621 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-15 21:12:10,623 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 142 msec 2023-07-15 21:12:10,782 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 21:12:10,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-15 21:12:10,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 21:12:10,791 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38601] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689455529822.3e988182b6c4d37d28697476ab4ffb83. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 21:12:10,792 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44797] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689455529822.8fe03472607d0be07f8d2b650875e7fe. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 21:12:10,796 DEBUG [Listener at jenkins-hbase4.apache.org/44607] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,796 DEBUG [Listener at jenkins-hbase4.apache.org/44607] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689455529822.3e988182b6c4d37d28697476ab4ffb83. 2023-07-15 21:12:10,798 INFO [Listener at jenkins-hbase4.apache.org/44607] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 21:12:10,810 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-15 21:12:10,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689455530810 (current time:1689455530810). 2023-07-15 21:12:10,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 21:12:10,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] zookeeper.ReadOnlyZKClient(139): Connect 0x50e548b5 to 127.0.0.1:57175 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 21:12:10,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@8a82c1f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 21:12:10,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:12:10,821 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55412, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:12:10,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x50e548b5 to 127.0.0.1:57175 2023-07-15 21:12:10,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 21:12:10,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] zookeeper.ReadOnlyZKClient(139): Connect 0x3ca830d8 to 127.0.0.1:57175 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 21:12:10,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@46727718, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 21:12:10,831 DEBUG [hconnection-0xf73631d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:12:10,834 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55418, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:12:10,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:12:10,841 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51232, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:12:10,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3ca830d8 to 127.0.0.1:57175 2023-07-15 21:12:10,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 21:12:10,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-15 21:12:10,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 21:12:10,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-15 21:12:10,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-15 21:12:10,847 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-15 21:12:10,848 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689456130848 2023-07-15 21:12:10,848 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-15 21:12:10,850 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 21:12:10,850 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 21:12:10,850 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-15 21:12:10,851 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-15 21:12:10,853 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 6 msec 2023-07-15 21:12:10,853 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-15 21:12:10,854 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689456130854 2023-07-15 21:12:10,867 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,867 INFO [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-15 21:12:10,867 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:12:10,868 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-15 21:12:10,868 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-15 21:12:10,869 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,869 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,870 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:10,870 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:10,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:10,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:10,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:10,870 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:10,870 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:10,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:10,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:10,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:10,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,870 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:10,871 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:10,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,871 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,871 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:10,871 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 21:12:10,871 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,871 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-15 21:12:10,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,871 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-15 21:12:10,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-15 21:12:10,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-15 21:12:10,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,872 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,872 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-15 21:12:10,872 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-15 21:12:10,872 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:12:10,872 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-15 21:12:10,873 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-15 21:12:10,873 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,873 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-15 21:12:10,873 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-15 21:12:10,873 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38601,1689455451863' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-15 21:12:10,873 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,873 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:12:10,874 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-15 21:12:10,875 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-15 21:12:10,875 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-15 21:12:10,875 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44797,1689455451778' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-15 21:12:10,875 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:12:10,876 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-15 21:12:10,876 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-15 21:12:10,876 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35469,1689455451912' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-15 21:12:10,877 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:10,877 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:10,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:12:10,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:12:10,877 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:10,877 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,879 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,880 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,880 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:12:10,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:12:10,880 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,880 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:12:10,880 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,880 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:12:10,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:12:10,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:10,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:10,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:10,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:12:10,882 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38601,1689455451863' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-15 21:12:10,882 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@73c043c[Count = 1] remaining members to acquire global barrier 2023-07-15 21:12:10,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:10,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:12:10,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:12:10,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:12:10,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:12:10,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:10,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:10,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:10,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:12:10,884 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44797,1689455451778' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-15 21:12:10,884 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@73c043c[Count = 0] remaining members to acquire global barrier 2023-07-15 21:12:10,884 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-15 21:12:10,885 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,886 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,886 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,886 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,886 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:10,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,886 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-15 21:12:10,887 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-15 21:12:10,886 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-15 21:12:10,887 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-15 21:12:10,887 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,35469,1689455451912' in zk 2023-07-15 21:12:10,887 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:10,887 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 21:12:10,887 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 21:12:10,887 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689455529822.3e988182b6c4d37d28697476ab4ffb83. 2023-07-15 21:12:10,887 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 21:12:10,887 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 21:12:10,887 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689455529822.3e988182b6c4d37d28697476ab4ffb83. started... 2023-07-15 21:12:10,887 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 21:12:10,887 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689455529822.8fe03472607d0be07f8d2b650875e7fe. 2023-07-15 21:12:10,888 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689455529822.8fe03472607d0be07f8d2b650875e7fe. started... 2023-07-15 21:12:10,888 INFO [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 3e988182b6c4d37d28697476ab4ffb83 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-15 21:12:10,888 INFO [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 8fe03472607d0be07f8d2b650875e7fe 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-15 21:12:10,888 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-15 21:12:10,888 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:12:10,888 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-15 21:12:10,910 INFO [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=132 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithMergeRegion/3e988182b6c4d37d28697476ab4ffb83/.tmp/cf/7af97c6ae9ba4803a56b7466d262465f 2023-07-15 21:12:10,912 INFO [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.13 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithMergeRegion/8fe03472607d0be07f8d2b650875e7fe/.tmp/cf/177c6f430d864918bf2969d7f55b14da 2023-07-15 21:12:10,916 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithMergeRegion/3e988182b6c4d37d28697476ab4ffb83/.tmp/cf/7af97c6ae9ba4803a56b7466d262465f as hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithMergeRegion/3e988182b6c4d37d28697476ab4ffb83/cf/7af97c6ae9ba4803a56b7466d262465f 2023-07-15 21:12:10,918 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithMergeRegion/8fe03472607d0be07f8d2b650875e7fe/.tmp/cf/177c6f430d864918bf2969d7f55b14da as hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithMergeRegion/8fe03472607d0be07f8d2b650875e7fe/cf/177c6f430d864918bf2969d7f55b14da 2023-07-15 21:12:10,923 INFO [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithMergeRegion/3e988182b6c4d37d28697476ab4ffb83/cf/7af97c6ae9ba4803a56b7466d262465f, entries=2, sequenceid=6, filesize=5.0 K 2023-07-15 21:12:10,926 INFO [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 3e988182b6c4d37d28697476ab4ffb83 in 39ms, sequenceid=6, compaction requested=false 2023-07-15 21:12:10,926 INFO [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithMergeRegion/8fe03472607d0be07f8d2b650875e7fe/cf/177c6f430d864918bf2969d7f55b14da, entries=48, sequenceid=6, filesize=8.1 K 2023-07-15 21:12:10,926 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-15 21:12:10,927 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3e988182b6c4d37d28697476ab4ffb83: 2023-07-15 21:12:10,927 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689455529822.3e988182b6c4d37d28697476ab4ffb83.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,927 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 21:12:10,927 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithMergeRegion/3e988182b6c4d37d28697476ab4ffb83/cf/7af97c6ae9ba4803a56b7466d262465f] hfiles 2023-07-15 21:12:10,927 INFO [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 8fe03472607d0be07f8d2b650875e7fe in 39ms, sequenceid=6, compaction requested=false 2023-07-15 21:12:10,927 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithMergeRegion/3e988182b6c4d37d28697476ab4ffb83/cf/7af97c6ae9ba4803a56b7466d262465f for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,930 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8fe03472607d0be07f8d2b650875e7fe: 2023-07-15 21:12:10,930 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689455529822.8fe03472607d0be07f8d2b650875e7fe.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,930 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 21:12:10,931 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithMergeRegion/8fe03472607d0be07f8d2b650875e7fe/cf/177c6f430d864918bf2969d7f55b14da] hfiles 2023-07-15 21:12:10,931 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithMergeRegion/8fe03472607d0be07f8d2b650875e7fe/cf/177c6f430d864918bf2969d7f55b14da for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,948 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689455529822.3e988182b6c4d37d28697476ab4ffb83. completed. 2023-07-15 21:12:10,948 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689455529822.3e988182b6c4d37d28697476ab4ffb83. 2023-07-15 21:12:10,948 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 21:12:10,948 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 21:12:10,948 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:10,949 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-15 21:12:10,949 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,38601,1689455451863' in zk 2023-07-15 21:12:10,950 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:10,950 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-15 21:12:10,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:10,950 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:12:10,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:12:10,950 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 21:12:10,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:12:10,951 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-15 21:12:10,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:12:10,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:12:10,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-15 21:12:10,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-15 21:12:10,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,953 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 21:12:10,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:10,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:10,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:10,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:12:10,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,955 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689455529822.8fe03472607d0be07f8d2b650875e7fe. completed. 2023-07-15 21:12:10,955 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689455529822.8fe03472607d0be07f8d2b650875e7fe. 2023-07-15 21:12:10,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:10,955 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 21:12:10,955 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 21:12:10,955 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:10,955 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-15 21:12:10,955 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,44797,1689455451778' in zk 2023-07-15 21:12:10,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:10,959 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-15 21:12:10,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,38601,1689455451863': 2023-07-15 21:12:10,959 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:12:10,959 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:10,959 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-15 21:12:10,959 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38601,1689455451863' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-15 21:12:10,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:10,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:12:10,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:12:10,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:12:10,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:12:10,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:10,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:10,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:10,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:12:10,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:10,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:10,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:10,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,44797,1689455451778': 2023-07-15 21:12:10,965 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44797,1689455451778' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-15 21:12:10,965 INFO [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-15 21:12:10,965 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 21:12:10,965 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 21:12:10,965 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,965 INFO [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 21:12:10,971 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,971 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:12:10,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:12:10,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,971 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:10,971 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,971 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,971 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:10,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,971 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:10,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:10,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:10,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:12:10,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:10,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:10,972 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:10,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:10,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:10,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,973 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:10,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:12:10,973 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:10,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:10,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:10,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:10,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:12:10,979 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:10,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,979 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:10,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:10,980 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:10,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:10,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:10,982 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:10,982 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,982 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:10,983 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:10,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:10,983 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:10,983 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:10,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:10,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:10,983 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,983 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:10,983 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,983 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:10,983 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:10,983 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:10,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:10,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:10,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:10,983 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:10,983 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:12:10,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:10,983 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:10,984 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,985 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:10,985 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:10,985 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,985 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:10,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:10,986 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:10,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:10,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:11,007 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:11,025 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-15 21:12:11,025 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:11,026 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:11,026 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689455530848Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689455530983 (+135 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689455530983Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689455530993 (+10 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689455531001 (+8 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689455531025 (+24 ms) 2023-07-15 21:12:11,029 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-15 21:12:11,030 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 179 msec 2023-07-15 21:12:11,153 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 21:12:11,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-15 21:12:11,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 21:12:11,185 DEBUG [Listener at jenkins-hbase4.apache.org/44607] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-15 21:12:11,189 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51242, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-15 21:12:11,190 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35469] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-15 21:12:11,191 DEBUG [Listener at jenkins-hbase4.apache.org/44607] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-15 21:12:11,194 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55432, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-15 21:12:11,194 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38601] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-15 21:12:11,195 DEBUG [Listener at jenkins-hbase4.apache.org/44607] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-15 21:12:11,200 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59076, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-15 21:12:11,200 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44797] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-15 21:12:11,202 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-15 21:12:11,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:11,205 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 21:12:11,205 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-15 21:12:11,206 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 21:12:11,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-15 21:12:11,208 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d5baa088c5d4b9e50b688c2ed0ef8107 2023-07-15 21:12:11,209 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d5baa088c5d4b9e50b688c2ed0ef8107 empty. 2023-07-15 21:12:11,209 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c55cd8fad0aec58ffda9d5c96ac37cd4 2023-07-15 21:12:11,210 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d5baa088c5d4b9e50b688c2ed0ef8107 2023-07-15 21:12:11,210 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c55cd8fad0aec58ffda9d5c96ac37cd4 empty. 2023-07-15 21:12:11,210 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c55cd8fad0aec58ffda9d5c96ac37cd4 2023-07-15 21:12:11,210 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-15 21:12:11,220 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-15 21:12:11,222 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => d5baa088c5d4b9e50b688c2ed0ef8107, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689455531202.d5baa088c5d4b9e50b688c2ed0ef8107.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp 2023-07-15 21:12:11,222 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => c55cd8fad0aec58ffda9d5c96ac37cd4, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689455531202.c55cd8fad0aec58ffda9d5c96ac37cd4.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp 2023-07-15 21:12:11,237 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689455531202.d5baa088c5d4b9e50b688c2ed0ef8107.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:12:11,238 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing d5baa088c5d4b9e50b688c2ed0ef8107, disabling compactions & flushes 2023-07-15 21:12:11,238 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689455531202.d5baa088c5d4b9e50b688c2ed0ef8107. 2023-07-15 21:12:11,238 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689455531202.d5baa088c5d4b9e50b688c2ed0ef8107. 2023-07-15 21:12:11,238 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689455531202.d5baa088c5d4b9e50b688c2ed0ef8107. after waiting 0 ms 2023-07-15 21:12:11,238 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689455531202.d5baa088c5d4b9e50b688c2ed0ef8107. 2023-07-15 21:12:11,238 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689455531202.d5baa088c5d4b9e50b688c2ed0ef8107. 2023-07-15 21:12:11,238 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for d5baa088c5d4b9e50b688c2ed0ef8107: 2023-07-15 21:12:11,239 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689455531202.c55cd8fad0aec58ffda9d5c96ac37cd4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:12:11,239 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing c55cd8fad0aec58ffda9d5c96ac37cd4, disabling compactions & flushes 2023-07-15 21:12:11,239 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689455531202.c55cd8fad0aec58ffda9d5c96ac37cd4. 2023-07-15 21:12:11,239 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689455531202.c55cd8fad0aec58ffda9d5c96ac37cd4. 2023-07-15 21:12:11,239 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689455531202.c55cd8fad0aec58ffda9d5c96ac37cd4. after waiting 0 ms 2023-07-15 21:12:11,239 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689455531202.c55cd8fad0aec58ffda9d5c96ac37cd4. 2023-07-15 21:12:11,239 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689455531202.c55cd8fad0aec58ffda9d5c96ac37cd4. 2023-07-15 21:12:11,239 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for c55cd8fad0aec58ffda9d5c96ac37cd4: 2023-07-15 21:12:11,242 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 21:12:11,243 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689455531202.d5baa088c5d4b9e50b688c2ed0ef8107.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689455531242"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689455531242"}]},"ts":"1689455531242"} 2023-07-15 21:12:11,243 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689455531202.c55cd8fad0aec58ffda9d5c96ac37cd4.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689455531242"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689455531242"}]},"ts":"1689455531242"} 2023-07-15 21:12:11,245 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-15 21:12:11,246 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 21:12:11,246 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689455531246"}]},"ts":"1689455531246"} 2023-07-15 21:12:11,247 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-15 21:12:11,251 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 21:12:11,252 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 21:12:11,252 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 21:12:11,252 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 21:12:11,253 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 21:12:11,253 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d5baa088c5d4b9e50b688c2ed0ef8107, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c55cd8fad0aec58ffda9d5c96ac37cd4, ASSIGN}] 2023-07-15 21:12:11,255 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d5baa088c5d4b9e50b688c2ed0ef8107, ASSIGN 2023-07-15 21:12:11,255 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c55cd8fad0aec58ffda9d5c96ac37cd4, ASSIGN 2023-07-15 21:12:11,256 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d5baa088c5d4b9e50b688c2ed0ef8107, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44797,1689455451778; forceNewPlan=false, retain=false 2023-07-15 21:12:11,256 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c55cd8fad0aec58ffda9d5c96ac37cd4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35469,1689455451912; forceNewPlan=false, retain=false 2023-07-15 21:12:11,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-15 21:12:11,406 INFO [jenkins-hbase4:44929] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-15 21:12:11,410 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=d5baa088c5d4b9e50b688c2ed0ef8107, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:11,410 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=c55cd8fad0aec58ffda9d5c96ac37cd4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:11,410 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689455531202.d5baa088c5d4b9e50b688c2ed0ef8107.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689455531410"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689455531410"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689455531410"}]},"ts":"1689455531410"} 2023-07-15 21:12:11,410 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689455531202.c55cd8fad0aec58ffda9d5c96ac37cd4.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689455531410"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689455531410"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689455531410"}]},"ts":"1689455531410"} 2023-07-15 21:12:11,412 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure d5baa088c5d4b9e50b688c2ed0ef8107, server=jenkins-hbase4.apache.org,44797,1689455451778}] 2023-07-15 21:12:11,413 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure c55cd8fad0aec58ffda9d5c96ac37cd4, server=jenkins-hbase4.apache.org,35469,1689455451912}] 2023-07-15 21:12:11,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-15 21:12:11,570 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689455531202.d5baa088c5d4b9e50b688c2ed0ef8107. 2023-07-15 21:12:11,571 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d5baa088c5d4b9e50b688c2ed0ef8107, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689455531202.d5baa088c5d4b9e50b688c2ed0ef8107.', STARTKEY => '', ENDKEY => '2'} 2023-07-15 21:12:11,571 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689455531202.c55cd8fad0aec58ffda9d5c96ac37cd4. 2023-07-15 21:12:11,571 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c55cd8fad0aec58ffda9d5c96ac37cd4, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689455531202.c55cd8fad0aec58ffda9d5c96ac37cd4.', STARTKEY => '2', ENDKEY => ''} 2023-07-15 21:12:11,572 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689455531202.d5baa088c5d4b9e50b688c2ed0ef8107. service=AccessControlService 2023-07-15 21:12:11,572 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689455531202.c55cd8fad0aec58ffda9d5c96ac37cd4. service=AccessControlService 2023-07-15 21:12:11,572 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 21:12:11,572 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 d5baa088c5d4b9e50b688c2ed0ef8107 2023-07-15 21:12:11,572 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 21:12:11,572 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689455531202.d5baa088c5d4b9e50b688c2ed0ef8107.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:12:11,572 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d5baa088c5d4b9e50b688c2ed0ef8107 2023-07-15 21:12:11,572 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 c55cd8fad0aec58ffda9d5c96ac37cd4 2023-07-15 21:12:11,572 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d5baa088c5d4b9e50b688c2ed0ef8107 2023-07-15 21:12:11,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689455531202.c55cd8fad0aec58ffda9d5c96ac37cd4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:12:11,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c55cd8fad0aec58ffda9d5c96ac37cd4 2023-07-15 21:12:11,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c55cd8fad0aec58ffda9d5c96ac37cd4 2023-07-15 21:12:11,574 INFO [StoreOpener-d5baa088c5d4b9e50b688c2ed0ef8107-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d5baa088c5d4b9e50b688c2ed0ef8107 2023-07-15 21:12:11,575 INFO [StoreOpener-c55cd8fad0aec58ffda9d5c96ac37cd4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c55cd8fad0aec58ffda9d5c96ac37cd4 2023-07-15 21:12:11,576 DEBUG [StoreOpener-d5baa088c5d4b9e50b688c2ed0ef8107-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d5baa088c5d4b9e50b688c2ed0ef8107/cf 2023-07-15 21:12:11,576 DEBUG [StoreOpener-d5baa088c5d4b9e50b688c2ed0ef8107-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d5baa088c5d4b9e50b688c2ed0ef8107/cf 2023-07-15 21:12:11,577 INFO [StoreOpener-d5baa088c5d4b9e50b688c2ed0ef8107-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d5baa088c5d4b9e50b688c2ed0ef8107 columnFamilyName cf 2023-07-15 21:12:11,577 DEBUG [StoreOpener-c55cd8fad0aec58ffda9d5c96ac37cd4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c55cd8fad0aec58ffda9d5c96ac37cd4/cf 2023-07-15 21:12:11,577 DEBUG [StoreOpener-c55cd8fad0aec58ffda9d5c96ac37cd4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c55cd8fad0aec58ffda9d5c96ac37cd4/cf 2023-07-15 21:12:11,577 INFO [StoreOpener-c55cd8fad0aec58ffda9d5c96ac37cd4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c55cd8fad0aec58ffda9d5c96ac37cd4 columnFamilyName cf 2023-07-15 21:12:11,577 INFO [StoreOpener-d5baa088c5d4b9e50b688c2ed0ef8107-1] regionserver.HStore(310): Store=d5baa088c5d4b9e50b688c2ed0ef8107/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 21:12:11,578 INFO [StoreOpener-c55cd8fad0aec58ffda9d5c96ac37cd4-1] regionserver.HStore(310): Store=c55cd8fad0aec58ffda9d5c96ac37cd4/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 21:12:11,578 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d5baa088c5d4b9e50b688c2ed0ef8107 2023-07-15 21:12:11,578 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c55cd8fad0aec58ffda9d5c96ac37cd4 2023-07-15 21:12:11,578 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d5baa088c5d4b9e50b688c2ed0ef8107 2023-07-15 21:12:11,579 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c55cd8fad0aec58ffda9d5c96ac37cd4 2023-07-15 21:12:11,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d5baa088c5d4b9e50b688c2ed0ef8107 2023-07-15 21:12:11,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c55cd8fad0aec58ffda9d5c96ac37cd4 2023-07-15 21:12:11,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d5baa088c5d4b9e50b688c2ed0ef8107/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 21:12:11,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c55cd8fad0aec58ffda9d5c96ac37cd4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 21:12:11,584 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c55cd8fad0aec58ffda9d5c96ac37cd4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72111573, jitterRate=0.07454617321491241}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 21:12:11,584 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d5baa088c5d4b9e50b688c2ed0ef8107; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60287335, jitterRate=-0.10164870321750641}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 21:12:11,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c55cd8fad0aec58ffda9d5c96ac37cd4: 2023-07-15 21:12:11,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d5baa088c5d4b9e50b688c2ed0ef8107: 2023-07-15 21:12:11,585 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689455531202.d5baa088c5d4b9e50b688c2ed0ef8107., pid=69, masterSystemTime=1689455531564 2023-07-15 21:12:11,585 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689455531202.c55cd8fad0aec58ffda9d5c96ac37cd4., pid=70, masterSystemTime=1689455531565 2023-07-15 21:12:11,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689455531202.c55cd8fad0aec58ffda9d5c96ac37cd4. 2023-07-15 21:12:11,586 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689455531202.c55cd8fad0aec58ffda9d5c96ac37cd4. 2023-07-15 21:12:11,587 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=c55cd8fad0aec58ffda9d5c96ac37cd4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:11,587 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689455531202.d5baa088c5d4b9e50b688c2ed0ef8107. 2023-07-15 21:12:11,587 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689455531202.d5baa088c5d4b9e50b688c2ed0ef8107. 2023-07-15 21:12:11,587 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689455531202.c55cd8fad0aec58ffda9d5c96ac37cd4.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689455531587"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689455531587"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689455531587"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689455531587"}]},"ts":"1689455531587"} 2023-07-15 21:12:11,587 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=d5baa088c5d4b9e50b688c2ed0ef8107, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:11,587 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689455531202.d5baa088c5d4b9e50b688c2ed0ef8107.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689455531587"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689455531587"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689455531587"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689455531587"}]},"ts":"1689455531587"} 2023-07-15 21:12:11,590 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=68 2023-07-15 21:12:11,590 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure c55cd8fad0aec58ffda9d5c96ac37cd4, server=jenkins-hbase4.apache.org,35469,1689455451912 in 175 msec 2023-07-15 21:12:11,591 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-07-15 21:12:11,591 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure d5baa088c5d4b9e50b688c2ed0ef8107, server=jenkins-hbase4.apache.org,44797,1689455451778 in 177 msec 2023-07-15 21:12:11,594 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c55cd8fad0aec58ffda9d5c96ac37cd4, ASSIGN in 337 msec 2023-07-15 21:12:11,595 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-07-15 21:12:11,595 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d5baa088c5d4b9e50b688c2ed0ef8107, ASSIGN in 338 msec 2023-07-15 21:12:11,596 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 21:12:11,596 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689455531596"}]},"ts":"1689455531596"} 2023-07-15 21:12:11,597 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-15 21:12:11,599 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 21:12:11,599 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-15 21:12:11,601 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35469] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-15 21:12:11,602 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:12:11,602 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:12:11,602 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:12:11,602 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:12:11,605 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 21:12:11,605 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 21:12:11,605 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-15 21:12:11,605 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-15 21:12:11,605 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 21:12:11,606 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-15 21:12:11,606 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 21:12:11,606 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-15 21:12:11,607 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 402 msec 2023-07-15 21:12:11,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-15 21:12:11,811 INFO [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-15 21:12:11,838 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions d5baa088c5d4b9e50b688c2ed0ef8107, c55cd8fad0aec58ffda9d5c96ac37cd4 2023-07-15 21:12:11,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[d5baa088c5d4b9e50b688c2ed0ef8107, c55cd8fad0aec58ffda9d5c96ac37cd4], force=true 2023-07-15 21:12:11,850 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[d5baa088c5d4b9e50b688c2ed0ef8107, c55cd8fad0aec58ffda9d5c96ac37cd4], force=true 2023-07-15 21:12:11,850 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[d5baa088c5d4b9e50b688c2ed0ef8107, c55cd8fad0aec58ffda9d5c96ac37cd4], force=true 2023-07-15 21:12:11,850 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[d5baa088c5d4b9e50b688c2ed0ef8107, c55cd8fad0aec58ffda9d5c96ac37cd4], force=true 2023-07-15 21:12:11,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-15 21:12:11,894 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d5baa088c5d4b9e50b688c2ed0ef8107, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c55cd8fad0aec58ffda9d5c96ac37cd4, UNASSIGN}] 2023-07-15 21:12:11,896 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c55cd8fad0aec58ffda9d5c96ac37cd4, UNASSIGN 2023-07-15 21:12:11,896 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d5baa088c5d4b9e50b688c2ed0ef8107, UNASSIGN 2023-07-15 21:12:11,897 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=c55cd8fad0aec58ffda9d5c96ac37cd4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:11,897 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=d5baa088c5d4b9e50b688c2ed0ef8107, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:11,897 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689455531202.c55cd8fad0aec58ffda9d5c96ac37cd4.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689455531897"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689455531897"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689455531897"}]},"ts":"1689455531897"} 2023-07-15 21:12:11,897 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689455531202.d5baa088c5d4b9e50b688c2ed0ef8107.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689455531897"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689455531897"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689455531897"}]},"ts":"1689455531897"} 2023-07-15 21:12:11,899 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure d5baa088c5d4b9e50b688c2ed0ef8107, server=jenkins-hbase4.apache.org,44797,1689455451778}] 2023-07-15 21:12:11,900 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure c55cd8fad0aec58ffda9d5c96ac37cd4, server=jenkins-hbase4.apache.org,35469,1689455451912}] 2023-07-15 21:12:11,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-15 21:12:12,051 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c55cd8fad0aec58ffda9d5c96ac37cd4 2023-07-15 21:12:12,051 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d5baa088c5d4b9e50b688c2ed0ef8107 2023-07-15 21:12:12,053 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c55cd8fad0aec58ffda9d5c96ac37cd4, disabling compactions & flushes 2023-07-15 21:12:12,053 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d5baa088c5d4b9e50b688c2ed0ef8107, disabling compactions & flushes 2023-07-15 21:12:12,053 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689455531202.c55cd8fad0aec58ffda9d5c96ac37cd4. 2023-07-15 21:12:12,053 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689455531202.d5baa088c5d4b9e50b688c2ed0ef8107. 2023-07-15 21:12:12,053 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689455531202.c55cd8fad0aec58ffda9d5c96ac37cd4. 2023-07-15 21:12:12,053 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689455531202.d5baa088c5d4b9e50b688c2ed0ef8107. 2023-07-15 21:12:12,053 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689455531202.c55cd8fad0aec58ffda9d5c96ac37cd4. after waiting 0 ms 2023-07-15 21:12:12,054 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689455531202.d5baa088c5d4b9e50b688c2ed0ef8107. after waiting 0 ms 2023-07-15 21:12:12,054 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689455531202.d5baa088c5d4b9e50b688c2ed0ef8107. 2023-07-15 21:12:12,054 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689455531202.c55cd8fad0aec58ffda9d5c96ac37cd4. 2023-07-15 21:12:12,054 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing d5baa088c5d4b9e50b688c2ed0ef8107 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-15 21:12:12,054 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing c55cd8fad0aec58ffda9d5c96ac37cd4 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-15 21:12:12,066 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d5baa088c5d4b9e50b688c2ed0ef8107/.tmp/cf/fc223830ad6b43e9bf666297a539c15b 2023-07-15 21:12:12,068 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c55cd8fad0aec58ffda9d5c96ac37cd4/.tmp/cf/7a60bfbf0b824346a0f211ddadfc0e6a 2023-07-15 21:12:12,072 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d5baa088c5d4b9e50b688c2ed0ef8107/.tmp/cf/fc223830ad6b43e9bf666297a539c15b as hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d5baa088c5d4b9e50b688c2ed0ef8107/cf/fc223830ad6b43e9bf666297a539c15b 2023-07-15 21:12:12,082 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d5baa088c5d4b9e50b688c2ed0ef8107/cf/fc223830ad6b43e9bf666297a539c15b, entries=1, sequenceid=5, filesize=4.7 K 2023-07-15 21:12:12,083 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for d5baa088c5d4b9e50b688c2ed0ef8107 in 29ms, sequenceid=5, compaction requested=false 2023-07-15 21:12:12,083 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-15 21:12:12,084 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c55cd8fad0aec58ffda9d5c96ac37cd4/.tmp/cf/7a60bfbf0b824346a0f211ddadfc0e6a as hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c55cd8fad0aec58ffda9d5c96ac37cd4/cf/7a60bfbf0b824346a0f211ddadfc0e6a 2023-07-15 21:12:12,092 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d5baa088c5d4b9e50b688c2ed0ef8107/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-15 21:12:12,093 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 21:12:12,093 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689455531202.d5baa088c5d4b9e50b688c2ed0ef8107. 2023-07-15 21:12:12,093 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d5baa088c5d4b9e50b688c2ed0ef8107: 2023-07-15 21:12:12,095 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d5baa088c5d4b9e50b688c2ed0ef8107 2023-07-15 21:12:12,095 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c55cd8fad0aec58ffda9d5c96ac37cd4/cf/7a60bfbf0b824346a0f211ddadfc0e6a, entries=1, sequenceid=5, filesize=4.7 K 2023-07-15 21:12:12,096 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=d5baa088c5d4b9e50b688c2ed0ef8107, regionState=CLOSED 2023-07-15 21:12:12,096 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689455531202.d5baa088c5d4b9e50b688c2ed0ef8107.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689455532096"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689455532096"}]},"ts":"1689455532096"} 2023-07-15 21:12:12,096 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for c55cd8fad0aec58ffda9d5c96ac37cd4 in 42ms, sequenceid=5, compaction requested=false 2023-07-15 21:12:12,104 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=72 2023-07-15 21:12:12,104 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure d5baa088c5d4b9e50b688c2ed0ef8107, server=jenkins-hbase4.apache.org,44797,1689455451778 in 203 msec 2023-07-15 21:12:12,105 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c55cd8fad0aec58ffda9d5c96ac37cd4/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-15 21:12:12,106 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d5baa088c5d4b9e50b688c2ed0ef8107, UNASSIGN in 214 msec 2023-07-15 21:12:12,106 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 21:12:12,106 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689455531202.c55cd8fad0aec58ffda9d5c96ac37cd4. 2023-07-15 21:12:12,106 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c55cd8fad0aec58ffda9d5c96ac37cd4: 2023-07-15 21:12:12,108 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c55cd8fad0aec58ffda9d5c96ac37cd4 2023-07-15 21:12:12,108 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=c55cd8fad0aec58ffda9d5c96ac37cd4, regionState=CLOSED 2023-07-15 21:12:12,108 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689455531202.c55cd8fad0aec58ffda9d5c96ac37cd4.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689455532108"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689455532108"}]},"ts":"1689455532108"} 2023-07-15 21:12:12,112 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=73 2023-07-15 21:12:12,112 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure c55cd8fad0aec58ffda9d5c96ac37cd4, server=jenkins-hbase4.apache.org,35469,1689455451912 in 210 msec 2023-07-15 21:12:12,113 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=71 2023-07-15 21:12:12,113 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c55cd8fad0aec58ffda9d5c96ac37cd4, UNASSIGN in 218 msec 2023-07-15 21:12:12,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-15 21:12:12,185 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f08cac4ac166f4af68830903cb7c4d83/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-15 21:12:12,188 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689455531202.d5baa088c5d4b9e50b688c2ed0ef8107.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-15 21:12:12,188 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689455531202.c55cd8fad0aec58ffda9d5c96ac37cd4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-15 21:12:12,188 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689455531203.f08cac4ac166f4af68830903cb7c4d83.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-15 21:12:12,247 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f08cac4ac166f4af68830903cb7c4d83, ASSIGN}] 2023-07-15 21:12:12,248 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f08cac4ac166f4af68830903cb7c4d83, ASSIGN 2023-07-15 21:12:12,248 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f08cac4ac166f4af68830903cb7c4d83, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,44797,1689455451778; forceNewPlan=false, retain=false 2023-07-15 21:12:12,399 INFO [jenkins-hbase4:44929] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-15 21:12:12,401 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=f08cac4ac166f4af68830903cb7c4d83, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:12,401 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689455531203.f08cac4ac166f4af68830903cb7c4d83.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689455532400"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689455532400"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689455532400"}]},"ts":"1689455532400"} 2023-07-15 21:12:12,403 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure f08cac4ac166f4af68830903cb7c4d83, server=jenkins-hbase4.apache.org,44797,1689455451778}] 2023-07-15 21:12:12,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-15 21:12:12,557 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689455531203.f08cac4ac166f4af68830903cb7c4d83. 2023-07-15 21:12:12,557 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f08cac4ac166f4af68830903cb7c4d83, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689455531203.f08cac4ac166f4af68830903cb7c4d83.', STARTKEY => '', ENDKEY => ''} 2023-07-15 21:12:12,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689455531203.f08cac4ac166f4af68830903cb7c4d83. service=AccessControlService 2023-07-15 21:12:12,558 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 21:12:12,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 f08cac4ac166f4af68830903cb7c4d83 2023-07-15 21:12:12,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689455531203.f08cac4ac166f4af68830903cb7c4d83.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:12:12,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f08cac4ac166f4af68830903cb7c4d83 2023-07-15 21:12:12,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f08cac4ac166f4af68830903cb7c4d83 2023-07-15 21:12:12,560 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f08cac4ac166f4af68830903cb7c4d83/.regioninfo 2023-07-15 21:12:12,569 INFO [StoreOpener-f08cac4ac166f4af68830903cb7c4d83-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f08cac4ac166f4af68830903cb7c4d83 2023-07-15 21:12:12,571 DEBUG [StoreOpener-f08cac4ac166f4af68830903cb7c4d83-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f08cac4ac166f4af68830903cb7c4d83/cf 2023-07-15 21:12:12,571 DEBUG [StoreOpener-f08cac4ac166f4af68830903cb7c4d83-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f08cac4ac166f4af68830903cb7c4d83/cf 2023-07-15 21:12:12,571 INFO [StoreOpener-f08cac4ac166f4af68830903cb7c4d83-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f08cac4ac166f4af68830903cb7c4d83 columnFamilyName cf 2023-07-15 21:12:12,610 DEBUG [StoreOpener-f08cac4ac166f4af68830903cb7c4d83-1] regionserver.HStore(539): loaded hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f08cac4ac166f4af68830903cb7c4d83/cf/7a60bfbf0b824346a0f211ddadfc0e6a.c55cd8fad0aec58ffda9d5c96ac37cd4->hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c55cd8fad0aec58ffda9d5c96ac37cd4/cf/7a60bfbf0b824346a0f211ddadfc0e6a-top 2023-07-15 21:12:12,617 DEBUG [StoreOpener-f08cac4ac166f4af68830903cb7c4d83-1] regionserver.HStore(539): loaded hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f08cac4ac166f4af68830903cb7c4d83/cf/fc223830ad6b43e9bf666297a539c15b.d5baa088c5d4b9e50b688c2ed0ef8107->hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d5baa088c5d4b9e50b688c2ed0ef8107/cf/fc223830ad6b43e9bf666297a539c15b-top 2023-07-15 21:12:12,618 INFO [StoreOpener-f08cac4ac166f4af68830903cb7c4d83-1] regionserver.HStore(310): Store=f08cac4ac166f4af68830903cb7c4d83/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 21:12:12,618 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f08cac4ac166f4af68830903cb7c4d83 2023-07-15 21:12:12,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f08cac4ac166f4af68830903cb7c4d83 2023-07-15 21:12:12,623 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f08cac4ac166f4af68830903cb7c4d83 2023-07-15 21:12:12,624 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f08cac4ac166f4af68830903cb7c4d83; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61404823, jitterRate=-0.08499683439731598}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 21:12:12,624 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f08cac4ac166f4af68830903cb7c4d83: 2023-07-15 21:12:12,625 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689455531203.f08cac4ac166f4af68830903cb7c4d83., pid=77, masterSystemTime=1689455532554 2023-07-15 21:12:12,626 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689455531203.f08cac4ac166f4af68830903cb7c4d83.,because compaction is disabled. 2023-07-15 21:12:12,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689455531203.f08cac4ac166f4af68830903cb7c4d83. 2023-07-15 21:12:12,627 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689455531203.f08cac4ac166f4af68830903cb7c4d83. 2023-07-15 21:12:12,628 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=f08cac4ac166f4af68830903cb7c4d83, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:12,628 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689455531203.f08cac4ac166f4af68830903cb7c4d83.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689455532628"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689455532628"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689455532628"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689455532628"}]},"ts":"1689455532628"} 2023-07-15 21:12:12,632 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-15 21:12:12,632 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure f08cac4ac166f4af68830903cb7c4d83, server=jenkins-hbase4.apache.org,44797,1689455451778 in 227 msec 2023-07-15 21:12:12,634 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-15 21:12:12,634 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f08cac4ac166f4af68830903cb7c4d83, ASSIGN in 385 msec 2023-07-15 21:12:12,636 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[d5baa088c5d4b9e50b688c2ed0ef8107, c55cd8fad0aec58ffda9d5c96ac37cd4], force=true in 792 msec 2023-07-15 21:12:12,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-15 21:12:12,959 INFO [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-15 21:12:12,960 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-15 21:12:12,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689455532960 (current time:1689455532960). 2023-07-15 21:12:12,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 21:12:12,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] zookeeper.ReadOnlyZKClient(139): Connect 0x2e21dfb9 to 127.0.0.1:57175 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 21:12:12,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@553db527, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 21:12:12,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:12:12,972 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55434, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:12:12,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2e21dfb9 to 127.0.0.1:57175 2023-07-15 21:12:12,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 21:12:12,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] zookeeper.ReadOnlyZKClient(139): Connect 0x437e5a25 to 127.0.0.1:57175 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 21:12:12,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@638299e4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 21:12:12,983 DEBUG [hconnection-0x5bae8c3e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:12:12,986 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55438, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:12:12,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:12:12,993 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51256, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:12:12,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x437e5a25 to 127.0.0.1:57175 2023-07-15 21:12:12,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 21:12:12,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-15 21:12:12,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 21:12:12,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-15 21:12:12,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-15 21:12:12,997 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-15 21:12:12,998 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689456132998 2023-07-15 21:12:12,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-15 21:12:12,998 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:13,001 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 21:12:13,001 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 21:12:13,002 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-15 21:12:13,003 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-15 21:12:13,004 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 6 msec 2023-07-15 21:12:13,005 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-15 21:12:13,006 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689456133006 2023-07-15 21:12:13,026 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:13,027 INFO [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-15 21:12:13,027 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:12:13,028 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-15 21:12:13,028 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-15 21:12:13,030 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:13,030 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:13,031 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:13,031 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:13,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:13,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:13,031 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:13,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:13,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:13,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:13,031 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:13,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:13,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:13,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:13,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:13,033 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:13,033 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 21:12:13,033 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:13,033 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:13,033 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:13,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-15 21:12:13,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:13,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-15 21:12:13,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:13,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-15 21:12:13,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:13,033 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-15 21:12:13,034 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-15 21:12:13,034 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-15 21:12:13,036 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:13,036 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-15 21:12:13,036 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:12:13,040 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:13,040 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-15 21:12:13,041 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:12:13,041 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:13,043 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-15 21:12:13,043 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-15 21:12:13,043 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-15 21:12:13,043 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35469,1689455451912' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-15 21:12:13,043 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-15 21:12:13,043 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44797,1689455451778' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-15 21:12:13,043 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-15 21:12:13,043 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:12:13,045 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-15 21:12:13,045 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-15 21:12:13,045 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38601,1689455451863' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-15 21:12:13,046 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:13,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:13,047 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:13,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:12:13,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:12:13,047 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:13,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:12:13,048 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:13,048 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:12:13,047 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:13,048 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:13,048 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:12:13,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:12:13,048 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:13,048 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:12:13,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:13,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:13,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:13,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:13,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:12:13,050 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44797,1689455451778' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-15 21:12:13,050 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1f0ed67a[Count = 0] remaining members to acquire global barrier 2023-07-15 21:12:13,050 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-15 21:12:13,050 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:13,052 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:13,052 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:13,052 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:13,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:13,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:13,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:13,053 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-15 21:12:13,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:13,053 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:13,053 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 21:12:13,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:13,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:13,053 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-15 21:12:13,053 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-15 21:12:13,053 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-15 21:12:13,053 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-15 21:12:13,053 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,35469,1689455451912' in zk 2023-07-15 21:12:13,053 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,38601,1689455451863' in zk 2023-07-15 21:12:13,055 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-15 21:12:13,055 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:12:13,055 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-15 21:12:13,056 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-15 21:12:13,056 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:12:13,056 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-15 21:12:13,064 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 21:12:13,064 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 21:12:13,065 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689455531203.f08cac4ac166f4af68830903cb7c4d83. 2023-07-15 21:12:13,066 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689455531203.f08cac4ac166f4af68830903cb7c4d83. started... 2023-07-15 21:12:13,067 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f08cac4ac166f4af68830903cb7c4d83: 2023-07-15 21:12:13,067 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689455531203.f08cac4ac166f4af68830903cb7c4d83.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:13,067 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 21:12:13,067 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f08cac4ac166f4af68830903cb7c4d83/cf/7a60bfbf0b824346a0f211ddadfc0e6a.c55cd8fad0aec58ffda9d5c96ac37cd4->hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c55cd8fad0aec58ffda9d5c96ac37cd4/cf/7a60bfbf0b824346a0f211ddadfc0e6a-top, hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f08cac4ac166f4af68830903cb7c4d83/cf/fc223830ad6b43e9bf666297a539c15b.d5baa088c5d4b9e50b688c2ed0ef8107->hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d5baa088c5d4b9e50b688c2ed0ef8107/cf/fc223830ad6b43e9bf666297a539c15b-top] hfiles 2023-07-15 21:12:13,067 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f08cac4ac166f4af68830903cb7c4d83/cf/7a60bfbf0b824346a0f211ddadfc0e6a.c55cd8fad0aec58ffda9d5c96ac37cd4 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:13,068 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f08cac4ac166f4af68830903cb7c4d83/cf/fc223830ad6b43e9bf666297a539c15b.d5baa088c5d4b9e50b688c2ed0ef8107 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:13,104 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 21:12:13,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-15 21:12:13,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-15 21:12:13,105 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 21:12:13,125 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689455531203.f08cac4ac166f4af68830903cb7c4d83. completed. 2023-07-15 21:12:13,125 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689455531203.f08cac4ac166f4af68830903cb7c4d83. 2023-07-15 21:12:13,125 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 21:12:13,126 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 21:12:13,126 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:13,126 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-15 21:12:13,126 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,44797,1689455451778' in zk 2023-07-15 21:12:13,133 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-15 21:12:13,134 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:12:13,134 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-15 21:12:13,134 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:13,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:13,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:12:13,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:12:13,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:12:13,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:12:13,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:13,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:13,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:13,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:13,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:12:13,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:13,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:13,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:13,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:13,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,44797,1689455451778': 2023-07-15 21:12:13,141 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44797,1689455451778' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-15 21:12:13,141 INFO [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-15 21:12:13,141 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 21:12:13,141 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 21:12:13,141 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:13,141 INFO [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 21:12:13,143 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:13,143 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:13,143 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:13,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:13,143 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:13,143 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:13,143 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:13,144 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:13,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:13,143 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:13,143 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:13,143 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:13,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:13,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:12:13,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:12:13,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:13,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:13,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:13,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:13,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:13,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:13,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:13,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:13,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:13,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:12:13,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:13,150 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:13,151 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:13,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:13,152 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:13,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:12:13,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:13,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:13,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:13,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:13,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:12:13,155 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:13,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:13,155 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:13,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:13,156 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:13,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:13,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:13,160 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:13,160 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:13,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:13,160 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:13,160 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:13,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:13,161 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:13,161 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:13,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:13,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:13,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:13,161 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:13,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:13,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:13,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:13,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:13,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:13,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:13,162 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:13,162 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:13,162 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:13,162 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:13,162 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:13,162 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:13,162 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:13,162 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:13,162 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:12:13,162 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:13,162 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:13,162 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:13,162 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:13,162 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:13,163 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:13,267 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:13,306 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 21:12:13,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-15 21:12:13,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-15 21:12:13,308 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-15 21:12:13,325 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-15 21:12:13,325 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:13,326 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:13,326 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689455532998Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689455533162 (+164 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689455533163 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689455533184 (+21 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689455533257 (+73 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689455533325 (+68 ms) 2023-07-15 21:12:13,329 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-15 21:12:13,331 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 328 msec 2023-07-15 21:12:13,608 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 21:12:13,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-15 21:12:13,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 21:12:13,609 INFO [Listener at jenkins-hbase4.apache.org/44607] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/export-test/export-1689455533609 2023-07-15 21:12:13,609 INFO [Listener at jenkins-hbase4.apache.org/44607] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:45529, tgtDir=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/export-test/export-1689455533609, rawTgtDir=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/export-test/export-1689455533609, srcFsUri=hdfs://localhost:45529, srcDir=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f 2023-07-15 21:12:13,638 DEBUG [Listener at jenkins-hbase4.apache.org/44607] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45529, inputRoot=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f 2023-07-15 21:12:13,638 DEBUG [Listener at jenkins-hbase4.apache.org/44607] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_162510374_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/export-test/export-1689455533609, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/export-test/export-1689455533609/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:13,638 INFO [Listener at jenkins-hbase4.apache.org/44607] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45529, inputRoot=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f, snapshotDir=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-15 21:12:13,654 INFO [Listener at jenkins-hbase4.apache.org/44607] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/export-test/export-1689455533609/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:14,120 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:14,121 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:14,122 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:14,122 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:14,124 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:14,124 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:14,125 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:14,126 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689455460014_0004_000001 (auth:SIMPLE) 2023-07-15 21:12:14,206 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/hadoop-6570639768946509405.jar 2023-07-15 21:12:14,207 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:14,208 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:14,208 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:14,209 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:14,209 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:14,210 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:14,210 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-15 21:12:14,211 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-15 21:12:14,212 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-15 21:12:14,212 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-15 21:12:14,213 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-15 21:12:14,214 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-15 21:12:14,214 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-15 21:12:14,215 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-15 21:12:14,215 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-15 21:12:14,216 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-15 21:12:14,216 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 21:12:14,217 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 21:12:14,218 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 21:12:14,218 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 21:12:14,218 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 21:12:14,219 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 21:12:14,220 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 21:12:15,226 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-15 21:12:15,567 WARN [Listener at jenkins-hbase4.apache.org/44607] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-15 21:12:15,571 INFO [Listener at jenkins-hbase4.apache.org/44607] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-15 21:12:15,573 DEBUG [Listener at jenkins-hbase4.apache.org/44607] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-15 21:12:15,689 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 21:12:15,689 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 21:12:15,947 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689455460014_0005_000001 (auth:SIMPLE) 2023-07-15 21:12:22,405 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689455460014_0005_000001 (auth:SIMPLE) 2023-07-15 21:12:24,700 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689455460014_0005_000001 (auth:SIMPLE) 2023-07-15 21:12:30,932 INFO [Listener at jenkins-hbase4.apache.org/44607] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-15 21:12:30,937 INFO [Listener at jenkins-hbase4.apache.org/44607] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-15 21:12:30,951 INFO [Listener at jenkins-hbase4.apache.org/44607] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:30,952 INFO [Listener at jenkins-hbase4.apache.org/44607] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-15 21:12:30,952 INFO [Listener at jenkins-hbase4.apache.org/44607] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-15 21:12:30,953 DEBUG [Listener at jenkins-hbase4.apache.org/44607] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_404915474_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:30,954 DEBUG [Listener at jenkins-hbase4.apache.org/44607] snapshot.TestExportSnapshot(367): hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-15 21:12:30,954 DEBUG [Listener at jenkins-hbase4.apache.org/44607] snapshot.TestExportSnapshot(367): hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-15 21:12:30,954 DEBUG [Listener at jenkins-hbase4.apache.org/44607] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_404915474_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/export-test/export-1689455533609/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/export-test/export-1689455533609/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:30,955 DEBUG [Listener at jenkins-hbase4.apache.org/44607] snapshot.TestExportSnapshot(367): hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/export-test/export-1689455533609/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-15 21:12:30,955 DEBUG [Listener at jenkins-hbase4.apache.org/44607] snapshot.TestExportSnapshot(367): hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/export-test/export-1689455533609/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-15 21:12:30,963 INFO [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:30,964 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:30,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:30,969 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689455550969"}]},"ts":"1689455550969"} 2023-07-15 21:12:30,970 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-15 21:12:30,975 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-15 21:12:30,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-15 21:12:30,977 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f08cac4ac166f4af68830903cb7c4d83, UNASSIGN}] 2023-07-15 21:12:30,979 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f08cac4ac166f4af68830903cb7c4d83, UNASSIGN 2023-07-15 21:12:30,980 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=f08cac4ac166f4af68830903cb7c4d83, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:30,980 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689455531203.f08cac4ac166f4af68830903cb7c4d83.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689455550980"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689455550980"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689455550980"}]},"ts":"1689455550980"} 2023-07-15 21:12:30,983 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure f08cac4ac166f4af68830903cb7c4d83, server=jenkins-hbase4.apache.org,44797,1689455451778}] 2023-07-15 21:12:31,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-15 21:12:31,135 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f08cac4ac166f4af68830903cb7c4d83 2023-07-15 21:12:31,135 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f08cac4ac166f4af68830903cb7c4d83, disabling compactions & flushes 2023-07-15 21:12:31,135 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689455531203.f08cac4ac166f4af68830903cb7c4d83. 2023-07-15 21:12:31,135 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689455531203.f08cac4ac166f4af68830903cb7c4d83. 2023-07-15 21:12:31,135 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689455531203.f08cac4ac166f4af68830903cb7c4d83. after waiting 0 ms 2023-07-15 21:12:31,135 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689455531203.f08cac4ac166f4af68830903cb7c4d83. 2023-07-15 21:12:31,150 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f08cac4ac166f4af68830903cb7c4d83/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-15 21:12:31,151 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 21:12:31,152 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689455531203.f08cac4ac166f4af68830903cb7c4d83. 2023-07-15 21:12:31,152 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f08cac4ac166f4af68830903cb7c4d83: 2023-07-15 21:12:31,155 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=f08cac4ac166f4af68830903cb7c4d83, regionState=CLOSED 2023-07-15 21:12:31,156 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689455531203.f08cac4ac166f4af68830903cb7c4d83.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689455551155"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689455551155"}]},"ts":"1689455551155"} 2023-07-15 21:12:31,156 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f08cac4ac166f4af68830903cb7c4d83 2023-07-15 21:12:31,159 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-15 21:12:31,159 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure f08cac4ac166f4af68830903cb7c4d83, server=jenkins-hbase4.apache.org,44797,1689455451778 in 174 msec 2023-07-15 21:12:31,161 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-15 21:12:31,161 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f08cac4ac166f4af68830903cb7c4d83, UNASSIGN in 182 msec 2023-07-15 21:12:31,161 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689455551161"}]},"ts":"1689455551161"} 2023-07-15 21:12:31,163 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-15 21:12:31,184 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-15 21:12:31,186 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 221 msec 2023-07-15 21:12:31,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-15 21:12:31,281 INFO [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-15 21:12:31,282 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:31,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:31,287 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:31,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:31,288 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:31,289 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35469] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:31,292 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:31,292 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:31,293 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:31,293 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-15 21:12:31,294 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-15 21:12:31,294 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:31,295 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f08cac4ac166f4af68830903cb7c4d83 2023-07-15 21:12:31,295 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:31,295 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:12:31,295 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:12:31,296 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:12:31,296 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-15 21:12:31,296 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c55cd8fad0aec58ffda9d5c96ac37cd4 2023-07-15 21:12:31,296 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-15 21:12:31,296 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:31,296 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:12:31,296 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d5baa088c5d4b9e50b688c2ed0ef8107 2023-07-15 21:12:31,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-15 21:12:31,297 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 21:12:31,297 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 21:12:31,298 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 21:12:31,298 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-15 21:12:31,298 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-15 21:12:31,298 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c55cd8fad0aec58ffda9d5c96ac37cd4/cf, FileablePath, hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c55cd8fad0aec58ffda9d5c96ac37cd4/recovered.edits] 2023-07-15 21:12:31,300 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 21:12:31,301 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d5baa088c5d4b9e50b688c2ed0ef8107/cf, FileablePath, hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d5baa088c5d4b9e50b688c2ed0ef8107/recovered.edits] 2023-07-15 21:12:31,301 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f08cac4ac166f4af68830903cb7c4d83/cf, FileablePath, hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f08cac4ac166f4af68830903cb7c4d83/recovered.edits] 2023-07-15 21:12:31,306 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c55cd8fad0aec58ffda9d5c96ac37cd4/cf/7a60bfbf0b824346a0f211ddadfc0e6a to hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c55cd8fad0aec58ffda9d5c96ac37cd4/cf/7a60bfbf0b824346a0f211ddadfc0e6a 2023-07-15 21:12:31,312 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c55cd8fad0aec58ffda9d5c96ac37cd4/recovered.edits/8.seqid to hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c55cd8fad0aec58ffda9d5c96ac37cd4/recovered.edits/8.seqid 2023-07-15 21:12:31,312 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d5baa088c5d4b9e50b688c2ed0ef8107/cf/fc223830ad6b43e9bf666297a539c15b to hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d5baa088c5d4b9e50b688c2ed0ef8107/cf/fc223830ad6b43e9bf666297a539c15b 2023-07-15 21:12:31,317 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c55cd8fad0aec58ffda9d5c96ac37cd4 2023-07-15 21:12:31,317 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f08cac4ac166f4af68830903cb7c4d83/cf/7a60bfbf0b824346a0f211ddadfc0e6a.c55cd8fad0aec58ffda9d5c96ac37cd4 to hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f08cac4ac166f4af68830903cb7c4d83/cf/7a60bfbf0b824346a0f211ddadfc0e6a.c55cd8fad0aec58ffda9d5c96ac37cd4 2023-07-15 21:12:31,321 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f08cac4ac166f4af68830903cb7c4d83/cf/fc223830ad6b43e9bf666297a539c15b.d5baa088c5d4b9e50b688c2ed0ef8107 to hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f08cac4ac166f4af68830903cb7c4d83/cf/fc223830ad6b43e9bf666297a539c15b.d5baa088c5d4b9e50b688c2ed0ef8107 2023-07-15 21:12:31,323 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d5baa088c5d4b9e50b688c2ed0ef8107/recovered.edits/8.seqid to hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d5baa088c5d4b9e50b688c2ed0ef8107/recovered.edits/8.seqid 2023-07-15 21:12:31,324 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d5baa088c5d4b9e50b688c2ed0ef8107 2023-07-15 21:12:31,325 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f08cac4ac166f4af68830903cb7c4d83/recovered.edits/12.seqid to hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f08cac4ac166f4af68830903cb7c4d83/recovered.edits/12.seqid 2023-07-15 21:12:31,325 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f08cac4ac166f4af68830903cb7c4d83 2023-07-15 21:12:31,325 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-15 21:12:31,328 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:31,331 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-15 21:12:31,338 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-15 21:12:31,339 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:31,339 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-15 21:12:31,340 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689455531203.f08cac4ac166f4af68830903cb7c4d83.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689455551339"}]},"ts":"9223372036854775807"} 2023-07-15 21:12:31,342 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-15 21:12:31,343 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => f08cac4ac166f4af68830903cb7c4d83, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689455531203.f08cac4ac166f4af68830903cb7c4d83.', STARTKEY => '', ENDKEY => ''}] 2023-07-15 21:12:31,343 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-15 21:12:31,343 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689455551343"}]},"ts":"9223372036854775807"} 2023-07-15 21:12:31,346 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-15 21:12:31,348 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:31,350 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 66 msec 2023-07-15 21:12:31,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-15 21:12:31,399 INFO [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-15 21:12:31,399 INFO [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:31,400 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:31,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:31,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-15 21:12:31,408 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689455551408"}]},"ts":"1689455551408"} 2023-07-15 21:12:31,413 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-15 21:12:31,415 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-15 21:12:31,416 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=3e988182b6c4d37d28697476ab4ffb83, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=8fe03472607d0be07f8d2b650875e7fe, UNASSIGN}] 2023-07-15 21:12:31,417 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=8fe03472607d0be07f8d2b650875e7fe, UNASSIGN 2023-07-15 21:12:31,419 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=3e988182b6c4d37d28697476ab4ffb83, UNASSIGN 2023-07-15 21:12:31,419 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=8fe03472607d0be07f8d2b650875e7fe, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:31,420 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=3e988182b6c4d37d28697476ab4ffb83, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:31,420 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689455529822.8fe03472607d0be07f8d2b650875e7fe.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689455551419"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689455551419"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689455551419"}]},"ts":"1689455551419"} 2023-07-15 21:12:31,420 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689455529822.3e988182b6c4d37d28697476ab4ffb83.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689455551419"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689455551419"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689455551419"}]},"ts":"1689455551419"} 2023-07-15 21:12:31,422 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=86, state=RUNNABLE; CloseRegionProcedure 8fe03472607d0be07f8d2b650875e7fe, server=jenkins-hbase4.apache.org,44797,1689455451778}] 2023-07-15 21:12:31,423 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=85, state=RUNNABLE; CloseRegionProcedure 3e988182b6c4d37d28697476ab4ffb83, server=jenkins-hbase4.apache.org,38601,1689455451863}] 2023-07-15 21:12:31,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-15 21:12:31,577 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 8fe03472607d0be07f8d2b650875e7fe 2023-07-15 21:12:31,577 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8fe03472607d0be07f8d2b650875e7fe, disabling compactions & flushes 2023-07-15 21:12:31,577 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689455529822.8fe03472607d0be07f8d2b650875e7fe. 2023-07-15 21:12:31,577 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689455529822.8fe03472607d0be07f8d2b650875e7fe. 2023-07-15 21:12:31,577 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689455529822.8fe03472607d0be07f8d2b650875e7fe. after waiting 0 ms 2023-07-15 21:12:31,577 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689455529822.8fe03472607d0be07f8d2b650875e7fe. 2023-07-15 21:12:31,581 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 3e988182b6c4d37d28697476ab4ffb83 2023-07-15 21:12:31,581 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3e988182b6c4d37d28697476ab4ffb83, disabling compactions & flushes 2023-07-15 21:12:31,582 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689455529822.3e988182b6c4d37d28697476ab4ffb83. 2023-07-15 21:12:31,582 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689455529822.3e988182b6c4d37d28697476ab4ffb83. 2023-07-15 21:12:31,582 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689455529822.3e988182b6c4d37d28697476ab4ffb83. after waiting 0 ms 2023-07-15 21:12:31,582 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689455529822.3e988182b6c4d37d28697476ab4ffb83. 2023-07-15 21:12:31,589 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithMergeRegion/8fe03472607d0be07f8d2b650875e7fe/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 21:12:31,590 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 21:12:31,591 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689455529822.8fe03472607d0be07f8d2b650875e7fe. 2023-07-15 21:12:31,591 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithMergeRegion/3e988182b6c4d37d28697476ab4ffb83/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 21:12:31,591 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8fe03472607d0be07f8d2b650875e7fe: 2023-07-15 21:12:31,592 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 21:12:31,593 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689455529822.3e988182b6c4d37d28697476ab4ffb83. 2023-07-15 21:12:31,593 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3e988182b6c4d37d28697476ab4ffb83: 2023-07-15 21:12:31,594 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 8fe03472607d0be07f8d2b650875e7fe 2023-07-15 21:12:31,595 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=8fe03472607d0be07f8d2b650875e7fe, regionState=CLOSED 2023-07-15 21:12:31,595 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 3e988182b6c4d37d28697476ab4ffb83 2023-07-15 21:12:31,595 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689455529822.8fe03472607d0be07f8d2b650875e7fe.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689455551595"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689455551595"}]},"ts":"1689455551595"} 2023-07-15 21:12:31,595 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=3e988182b6c4d37d28697476ab4ffb83, regionState=CLOSED 2023-07-15 21:12:31,596 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689455529822.3e988182b6c4d37d28697476ab4ffb83.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689455551595"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689455551595"}]},"ts":"1689455551595"} 2023-07-15 21:12:31,600 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=86 2023-07-15 21:12:31,600 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=86, state=SUCCESS; CloseRegionProcedure 8fe03472607d0be07f8d2b650875e7fe, server=jenkins-hbase4.apache.org,44797,1689455451778 in 176 msec 2023-07-15 21:12:31,601 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=85 2023-07-15 21:12:31,601 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=85, state=SUCCESS; CloseRegionProcedure 3e988182b6c4d37d28697476ab4ffb83, server=jenkins-hbase4.apache.org,38601,1689455451863 in 175 msec 2023-07-15 21:12:31,603 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=8fe03472607d0be07f8d2b650875e7fe, UNASSIGN in 184 msec 2023-07-15 21:12:31,604 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=84 2023-07-15 21:12:31,604 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=3e988182b6c4d37d28697476ab4ffb83, UNASSIGN in 185 msec 2023-07-15 21:12:31,604 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689455551604"}]},"ts":"1689455551604"} 2023-07-15 21:12:31,606 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-15 21:12:31,608 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-15 21:12:31,609 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 208 msec 2023-07-15 21:12:31,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-15 21:12:31,710 INFO [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-15 21:12:31,710 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:31,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:31,714 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:31,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:31,714 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:31,716 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35469] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:31,718 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:31,719 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:31,719 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:31,719 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-15 21:12:31,719 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-15 21:12:31,719 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-15 21:12:31,719 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:31,720 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-15 21:12:31,720 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3e988182b6c4d37d28697476ab4ffb83 2023-07-15 21:12:31,720 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8fe03472607d0be07f8d2b650875e7fe 2023-07-15 21:12:31,721 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:31,721 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:31,721 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:31,721 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:12:31,721 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:12:31,721 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:31,722 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:12:31,721 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:12:31,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-15 21:12:31,723 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8fe03472607d0be07f8d2b650875e7fe/cf, FileablePath, hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8fe03472607d0be07f8d2b650875e7fe/recovered.edits] 2023-07-15 21:12:31,723 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3e988182b6c4d37d28697476ab4ffb83/cf, FileablePath, hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3e988182b6c4d37d28697476ab4ffb83/recovered.edits] 2023-07-15 21:12:31,728 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8fe03472607d0be07f8d2b650875e7fe/cf/177c6f430d864918bf2969d7f55b14da to hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/8fe03472607d0be07f8d2b650875e7fe/cf/177c6f430d864918bf2969d7f55b14da 2023-07-15 21:12:31,728 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3e988182b6c4d37d28697476ab4ffb83/cf/7af97c6ae9ba4803a56b7466d262465f to hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/3e988182b6c4d37d28697476ab4ffb83/cf/7af97c6ae9ba4803a56b7466d262465f 2023-07-15 21:12:31,731 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8fe03472607d0be07f8d2b650875e7fe/recovered.edits/9.seqid to hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/8fe03472607d0be07f8d2b650875e7fe/recovered.edits/9.seqid 2023-07-15 21:12:31,731 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3e988182b6c4d37d28697476ab4ffb83/recovered.edits/9.seqid to hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/3e988182b6c4d37d28697476ab4ffb83/recovered.edits/9.seqid 2023-07-15 21:12:31,731 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8fe03472607d0be07f8d2b650875e7fe 2023-07-15 21:12:31,732 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3e988182b6c4d37d28697476ab4ffb83 2023-07-15 21:12:31,732 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-15 21:12:31,734 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:31,737 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-15 21:12:31,740 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-15 21:12:31,741 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:31,741 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-15 21:12:31,741 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689455529822.3e988182b6c4d37d28697476ab4ffb83.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689455551741"}]},"ts":"9223372036854775807"} 2023-07-15 21:12:31,741 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689455529822.8fe03472607d0be07f8d2b650875e7fe.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689455551741"}]},"ts":"9223372036854775807"} 2023-07-15 21:12:31,743 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-15 21:12:31,743 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 3e988182b6c4d37d28697476ab4ffb83, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689455529822.3e988182b6c4d37d28697476ab4ffb83.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 8fe03472607d0be07f8d2b650875e7fe, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689455529822.8fe03472607d0be07f8d2b650875e7fe.', STARTKEY => '1', ENDKEY => ''}] 2023-07-15 21:12:31,743 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-15 21:12:31,743 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689455551743"}]},"ts":"9223372036854775807"} 2023-07-15 21:12:31,745 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-15 21:12:31,747 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:31,749 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 36 msec 2023-07-15 21:12:31,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-15 21:12:31,824 INFO [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-15 21:12:31,837 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-15 21:12:31,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:31,842 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-15 21:12:31,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:31,846 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-15 21:12:31,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:31,883 INFO [Listener at jenkins-hbase4.apache.org/44607] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=760 (was 749) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7100f96f-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7100f96f-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-805259312_1 at /127.0.0.1:51074 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1488416207) connection to jenkins-hbase4.apache.org/172.31.14.131:40235 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_404915474_17 at /127.0.0.1:54968 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_404915474_17 at /127.0.0.1:41822 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7100f96f-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7100f96f-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7100f96f-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_404915474_17 at /127.0.0.1:46850 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7100f96f-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3948 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) - Thread LEAK? -, OpenFileDescriptor=908 (was 902) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=486 (was 362) - SystemLoadAverage LEAK? -, ProcessCount=182 (was 178) - ProcessCount LEAK? -, AvailableMemoryMB=2208 (was 3643) 2023-07-15 21:12:31,883 WARN [Listener at jenkins-hbase4.apache.org/44607] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-15 21:12:31,906 INFO [Listener at jenkins-hbase4.apache.org/44607] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=760, OpenFileDescriptor=908, MaxFileDescriptor=60000, SystemLoadAverage=486, ProcessCount=182, AvailableMemoryMB=2207 2023-07-15 21:12:31,906 WARN [Listener at jenkins-hbase4.apache.org/44607] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-15 21:12:31,908 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-15 21:12:31,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-15 21:12:31,912 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 21:12:31,912 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-15 21:12:31,913 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 21:12:31,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-15 21:12:31,915 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testEmptyExportFileSystemState/f922a161a593f2e1090cf0e39659530b 2023-07-15 21:12:31,915 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testEmptyExportFileSystemState/baaba897b46fc91caa1d8351dc0fc1e2 2023-07-15 21:12:31,916 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testEmptyExportFileSystemState/f922a161a593f2e1090cf0e39659530b empty. 2023-07-15 21:12:31,916 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testEmptyExportFileSystemState/baaba897b46fc91caa1d8351dc0fc1e2 empty. 2023-07-15 21:12:31,916 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testEmptyExportFileSystemState/f922a161a593f2e1090cf0e39659530b 2023-07-15 21:12:31,916 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testEmptyExportFileSystemState/baaba897b46fc91caa1d8351dc0fc1e2 2023-07-15 21:12:31,917 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-15 21:12:31,927 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-15 21:12:31,929 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => f922a161a593f2e1090cf0e39659530b, NAME => 'testtb-testEmptyExportFileSystemState,,1689455551908.f922a161a593f2e1090cf0e39659530b.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp 2023-07-15 21:12:31,929 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => baaba897b46fc91caa1d8351dc0fc1e2, NAME => 'testtb-testEmptyExportFileSystemState,1,1689455551908.baaba897b46fc91caa1d8351dc0fc1e2.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp 2023-07-15 21:12:31,973 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689455551908.f922a161a593f2e1090cf0e39659530b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:12:31,973 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing f922a161a593f2e1090cf0e39659530b, disabling compactions & flushes 2023-07-15 21:12:31,973 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689455551908.f922a161a593f2e1090cf0e39659530b. 2023-07-15 21:12:31,973 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689455551908.f922a161a593f2e1090cf0e39659530b. 2023-07-15 21:12:31,973 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689455551908.f922a161a593f2e1090cf0e39659530b. after waiting 0 ms 2023-07-15 21:12:31,973 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689455551908.f922a161a593f2e1090cf0e39659530b. 2023-07-15 21:12:31,973 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689455551908.f922a161a593f2e1090cf0e39659530b. 2023-07-15 21:12:31,973 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for f922a161a593f2e1090cf0e39659530b: 2023-07-15 21:12:31,981 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689455551908.baaba897b46fc91caa1d8351dc0fc1e2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:12:31,981 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing baaba897b46fc91caa1d8351dc0fc1e2, disabling compactions & flushes 2023-07-15 21:12:31,981 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689455551908.baaba897b46fc91caa1d8351dc0fc1e2. 2023-07-15 21:12:31,982 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689455551908.baaba897b46fc91caa1d8351dc0fc1e2. 2023-07-15 21:12:31,982 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689455551908.baaba897b46fc91caa1d8351dc0fc1e2. after waiting 0 ms 2023-07-15 21:12:31,982 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689455551908.baaba897b46fc91caa1d8351dc0fc1e2. 2023-07-15 21:12:31,982 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689455551908.baaba897b46fc91caa1d8351dc0fc1e2. 2023-07-15 21:12:31,982 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for baaba897b46fc91caa1d8351dc0fc1e2: 2023-07-15 21:12:31,986 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 21:12:31,987 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689455551908.f922a161a593f2e1090cf0e39659530b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689455551987"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689455551987"}]},"ts":"1689455551987"} 2023-07-15 21:12:31,987 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689455551908.baaba897b46fc91caa1d8351dc0fc1e2.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689455551987"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689455551987"}]},"ts":"1689455551987"} 2023-07-15 21:12:31,990 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-15 21:12:31,994 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 21:12:31,994 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689455551994"}]},"ts":"1689455551994"} 2023-07-15 21:12:31,996 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-15 21:12:31,999 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 21:12:32,001 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 21:12:32,001 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 21:12:32,001 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 21:12:32,001 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 21:12:32,002 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f922a161a593f2e1090cf0e39659530b, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=baaba897b46fc91caa1d8351dc0fc1e2, ASSIGN}] 2023-07-15 21:12:32,005 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f922a161a593f2e1090cf0e39659530b, ASSIGN 2023-07-15 21:12:32,005 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=baaba897b46fc91caa1d8351dc0fc1e2, ASSIGN 2023-07-15 21:12:32,006 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=baaba897b46fc91caa1d8351dc0fc1e2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35469,1689455451912; forceNewPlan=false, retain=false 2023-07-15 21:12:32,006 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f922a161a593f2e1090cf0e39659530b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44797,1689455451778; forceNewPlan=false, retain=false 2023-07-15 21:12:32,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-15 21:12:32,156 INFO [jenkins-hbase4:44929] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-15 21:12:32,159 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=baaba897b46fc91caa1d8351dc0fc1e2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:32,159 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=f922a161a593f2e1090cf0e39659530b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:32,160 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689455551908.baaba897b46fc91caa1d8351dc0fc1e2.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689455552159"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689455552159"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689455552159"}]},"ts":"1689455552159"} 2023-07-15 21:12:32,160 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689455551908.f922a161a593f2e1090cf0e39659530b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689455552159"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689455552159"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689455552159"}]},"ts":"1689455552159"} 2023-07-15 21:12:32,161 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure f922a161a593f2e1090cf0e39659530b, server=jenkins-hbase4.apache.org,44797,1689455451778}] 2023-07-15 21:12:32,163 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure baaba897b46fc91caa1d8351dc0fc1e2, server=jenkins-hbase4.apache.org,35469,1689455451912}] 2023-07-15 21:12:32,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-15 21:12:32,320 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689455551908.baaba897b46fc91caa1d8351dc0fc1e2. 2023-07-15 21:12:32,321 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => baaba897b46fc91caa1d8351dc0fc1e2, NAME => 'testtb-testEmptyExportFileSystemState,1,1689455551908.baaba897b46fc91caa1d8351dc0fc1e2.', STARTKEY => '1', ENDKEY => ''} 2023-07-15 21:12:32,321 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689455551908.baaba897b46fc91caa1d8351dc0fc1e2. service=AccessControlService 2023-07-15 21:12:32,321 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 21:12:32,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState baaba897b46fc91caa1d8351dc0fc1e2 2023-07-15 21:12:32,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689455551908.baaba897b46fc91caa1d8351dc0fc1e2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:12:32,322 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689455551908.f922a161a593f2e1090cf0e39659530b. 2023-07-15 21:12:32,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for baaba897b46fc91caa1d8351dc0fc1e2 2023-07-15 21:12:32,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for baaba897b46fc91caa1d8351dc0fc1e2 2023-07-15 21:12:32,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f922a161a593f2e1090cf0e39659530b, NAME => 'testtb-testEmptyExportFileSystemState,,1689455551908.f922a161a593f2e1090cf0e39659530b.', STARTKEY => '', ENDKEY => '1'} 2023-07-15 21:12:32,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689455551908.f922a161a593f2e1090cf0e39659530b. service=AccessControlService 2023-07-15 21:12:32,322 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 21:12:32,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState f922a161a593f2e1090cf0e39659530b 2023-07-15 21:12:32,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689455551908.f922a161a593f2e1090cf0e39659530b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:12:32,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f922a161a593f2e1090cf0e39659530b 2023-07-15 21:12:32,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f922a161a593f2e1090cf0e39659530b 2023-07-15 21:12:32,323 INFO [StoreOpener-baaba897b46fc91caa1d8351dc0fc1e2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region baaba897b46fc91caa1d8351dc0fc1e2 2023-07-15 21:12:32,324 INFO [StoreOpener-f922a161a593f2e1090cf0e39659530b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f922a161a593f2e1090cf0e39659530b 2023-07-15 21:12:32,325 DEBUG [StoreOpener-baaba897b46fc91caa1d8351dc0fc1e2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testEmptyExportFileSystemState/baaba897b46fc91caa1d8351dc0fc1e2/cf 2023-07-15 21:12:32,325 DEBUG [StoreOpener-baaba897b46fc91caa1d8351dc0fc1e2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testEmptyExportFileSystemState/baaba897b46fc91caa1d8351dc0fc1e2/cf 2023-07-15 21:12:32,326 INFO [StoreOpener-baaba897b46fc91caa1d8351dc0fc1e2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region baaba897b46fc91caa1d8351dc0fc1e2 columnFamilyName cf 2023-07-15 21:12:32,326 INFO [StoreOpener-baaba897b46fc91caa1d8351dc0fc1e2-1] regionserver.HStore(310): Store=baaba897b46fc91caa1d8351dc0fc1e2/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 21:12:32,327 DEBUG [StoreOpener-f922a161a593f2e1090cf0e39659530b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testEmptyExportFileSystemState/f922a161a593f2e1090cf0e39659530b/cf 2023-07-15 21:12:32,327 DEBUG [StoreOpener-f922a161a593f2e1090cf0e39659530b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testEmptyExportFileSystemState/f922a161a593f2e1090cf0e39659530b/cf 2023-07-15 21:12:32,327 INFO [StoreOpener-f922a161a593f2e1090cf0e39659530b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f922a161a593f2e1090cf0e39659530b columnFamilyName cf 2023-07-15 21:12:32,327 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testEmptyExportFileSystemState/baaba897b46fc91caa1d8351dc0fc1e2 2023-07-15 21:12:32,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testEmptyExportFileSystemState/baaba897b46fc91caa1d8351dc0fc1e2 2023-07-15 21:12:32,328 INFO [StoreOpener-f922a161a593f2e1090cf0e39659530b-1] regionserver.HStore(310): Store=f922a161a593f2e1090cf0e39659530b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 21:12:32,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testEmptyExportFileSystemState/f922a161a593f2e1090cf0e39659530b 2023-07-15 21:12:32,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testEmptyExportFileSystemState/f922a161a593f2e1090cf0e39659530b 2023-07-15 21:12:32,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for baaba897b46fc91caa1d8351dc0fc1e2 2023-07-15 21:12:32,331 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f922a161a593f2e1090cf0e39659530b 2023-07-15 21:12:32,332 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testEmptyExportFileSystemState/baaba897b46fc91caa1d8351dc0fc1e2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 21:12:32,333 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened baaba897b46fc91caa1d8351dc0fc1e2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66680736, jitterRate=-0.006379604339599609}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 21:12:32,333 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for baaba897b46fc91caa1d8351dc0fc1e2: 2023-07-15 21:12:32,333 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testEmptyExportFileSystemState/f922a161a593f2e1090cf0e39659530b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 21:12:32,334 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689455551908.baaba897b46fc91caa1d8351dc0fc1e2., pid=94, masterSystemTime=1689455552314 2023-07-15 21:12:32,334 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f922a161a593f2e1090cf0e39659530b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59695425, jitterRate=-0.11046884953975677}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 21:12:32,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f922a161a593f2e1090cf0e39659530b: 2023-07-15 21:12:32,334 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689455551908.f922a161a593f2e1090cf0e39659530b., pid=93, masterSystemTime=1689455552314 2023-07-15 21:12:32,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689455551908.baaba897b46fc91caa1d8351dc0fc1e2. 2023-07-15 21:12:32,335 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689455551908.baaba897b46fc91caa1d8351dc0fc1e2. 2023-07-15 21:12:32,335 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=baaba897b46fc91caa1d8351dc0fc1e2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:32,336 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689455551908.baaba897b46fc91caa1d8351dc0fc1e2.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689455552335"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689455552335"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689455552335"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689455552335"}]},"ts":"1689455552335"} 2023-07-15 21:12:32,336 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689455551908.f922a161a593f2e1090cf0e39659530b. 2023-07-15 21:12:32,336 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689455551908.f922a161a593f2e1090cf0e39659530b. 2023-07-15 21:12:32,336 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=f922a161a593f2e1090cf0e39659530b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:32,336 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689455551908.f922a161a593f2e1090cf0e39659530b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689455552336"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689455552336"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689455552336"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689455552336"}]},"ts":"1689455552336"} 2023-07-15 21:12:32,339 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=92 2023-07-15 21:12:32,339 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure baaba897b46fc91caa1d8351dc0fc1e2, server=jenkins-hbase4.apache.org,35469,1689455451912 in 174 msec 2023-07-15 21:12:32,340 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=91 2023-07-15 21:12:32,340 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure f922a161a593f2e1090cf0e39659530b, server=jenkins-hbase4.apache.org,44797,1689455451778 in 177 msec 2023-07-15 21:12:32,340 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=baaba897b46fc91caa1d8351dc0fc1e2, ASSIGN in 338 msec 2023-07-15 21:12:32,342 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=91, resume processing ppid=90 2023-07-15 21:12:32,342 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f922a161a593f2e1090cf0e39659530b, ASSIGN in 339 msec 2023-07-15 21:12:32,342 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 21:12:32,342 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689455552342"}]},"ts":"1689455552342"} 2023-07-15 21:12:32,343 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-15 21:12:32,346 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 21:12:32,347 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-15 21:12:32,348 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35469] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-15 21:12:32,350 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:12:32,350 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:12:32,350 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:12:32,350 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:12:32,351 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-15 21:12:32,351 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-15 21:12:32,352 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-15 21:12:32,352 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-15 21:12:32,353 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 443 msec 2023-07-15 21:12:32,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-15 21:12:32,517 INFO [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-15 21:12:32,517 DEBUG [Listener at jenkins-hbase4.apache.org/44607] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testEmptyExportFileSystemState get assigned. Timeout = 60000ms 2023-07-15 21:12:32,518 INFO [Listener at jenkins-hbase4.apache.org/44607] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 21:12:32,527 INFO [Listener at jenkins-hbase4.apache.org/44607] hbase.HBaseTestingUtility(3484): All regions for table testtb-testEmptyExportFileSystemState assigned to meta. Checking AM states. 2023-07-15 21:12:32,527 INFO [Listener at jenkins-hbase4.apache.org/44607] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 21:12:32,527 INFO [Listener at jenkins-hbase4.apache.org/44607] hbase.HBaseTestingUtility(3504): All regions for table testtb-testEmptyExportFileSystemState assigned. 2023-07-15 21:12:32,533 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 21:12:32,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689455552533 (current time:1689455552533). 2023-07-15 21:12:32,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 21:12:32,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] zookeeper.ReadOnlyZKClient(139): Connect 0x0b4129a1 to 127.0.0.1:57175 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 21:12:32,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@297e794a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 21:12:32,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:12:32,550 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38554, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:12:32,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0b4129a1 to 127.0.0.1:57175 2023-07-15 21:12:32,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 21:12:32,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] zookeeper.ReadOnlyZKClient(139): Connect 0x7d69f142 to 127.0.0.1:57175 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 21:12:32,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7f67c36f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 21:12:32,565 DEBUG [hconnection-0x250941e0-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:12:32,568 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38566, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:12:32,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:12:32,574 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44188, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:12:32,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7d69f142 to 127.0.0.1:57175 2023-07-15 21:12:32,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 21:12:32,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-15 21:12:32,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 21:12:32,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 21:12:32,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-15 21:12:32,581 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-15 21:12:32,582 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689456152582 2023-07-15 21:12:32,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 21:12:32,582 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-15 21:12:32,583 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 21:12:32,583 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 21:12:32,584 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-15 21:12:32,585 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-15 21:12:32,586 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-15 21:12:32,589 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-15 21:12:32,593 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689456152593 2023-07-15 21:12:32,637 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,637 INFO [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-15 21:12:32,637 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:12:32,640 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-15 21:12:32,640 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-15 21:12:32,641 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,641 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,646 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:32,646 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:32,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:32,646 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:32,646 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:32,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:32,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:32,646 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:32,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:32,646 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:32,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:32,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:32,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,647 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:32,647 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 21:12:32,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,647 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,647 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-15 21:12:32,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,647 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-15 21:12:32,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,648 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-15 21:12:32,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-15 21:12:32,648 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-15 21:12:32,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,648 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,648 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-15 21:12:32,648 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-15 21:12:32,648 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:12:32,648 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,648 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-15 21:12:32,648 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:12:32,650 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,664 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-15 21:12:32,665 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-15 21:12:32,665 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35469,1689455451912' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-15 21:12:32,664 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-15 21:12:32,667 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-15 21:12:32,665 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-15 21:12:32,667 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:12:32,667 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44797,1689455451778' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-15 21:12:32,668 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-15 21:12:32,668 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-15 21:12:32,668 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38601,1689455451863' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-15 21:12:32,670 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,670 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:32,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:32,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:12:32,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:12:32,672 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:32,672 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,672 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,673 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,673 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:12:32,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:12:32,673 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,673 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:12:32,673 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,673 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:12:32,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:12:32,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:32,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:32,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:32,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:12:32,676 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35469,1689455451912' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-15 21:12:32,676 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@341375c0[Count = 1] remaining members to acquire global barrier 2023-07-15 21:12:32,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:32,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:12:32,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:12:32,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:12:32,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:12:32,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:32,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:32,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:32,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:12:32,683 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44797,1689455451778' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-15 21:12:32,683 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@341375c0[Count = 0] remaining members to acquire global barrier 2023-07-15 21:12:32,683 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-15 21:12:32,683 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,683 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 21:12:32,684 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 21:12:32,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,685 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:32,685 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,685 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-15 21:12:32,685 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,689 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-15 21:12:32,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-15 21:12:32,689 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:32,692 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 21:12:32,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,693 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 21:12:32,693 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-15 21:12:32,693 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-15 21:12:32,693 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,38601,1689455451863' in zk 2023-07-15 21:12:32,695 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-15 21:12:32,695 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:12:32,695 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-15 21:12:32,699 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 21:12:32,701 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 21:12:32,701 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689455551908.f922a161a593f2e1090cf0e39659530b. 2023-07-15 21:12:32,701 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689455551908.f922a161a593f2e1090cf0e39659530b. started... 2023-07-15 21:12:32,702 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 21:12:32,704 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 21:12:32,704 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f922a161a593f2e1090cf0e39659530b: 2023-07-15 21:12:32,704 DEBUG [rs(jenkins-hbase4.apache.org,35469,1689455451912)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689455551908.baaba897b46fc91caa1d8351dc0fc1e2. 2023-07-15 21:12:32,705 DEBUG [rs(jenkins-hbase4.apache.org,35469,1689455451912)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689455551908.baaba897b46fc91caa1d8351dc0fc1e2. started... 2023-07-15 21:12:32,705 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689455551908.f922a161a593f2e1090cf0e39659530b.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,705 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 21:12:32,707 DEBUG [rs(jenkins-hbase4.apache.org,35469,1689455451912)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for baaba897b46fc91caa1d8351dc0fc1e2: 2023-07-15 21:12:32,707 DEBUG [rs(jenkins-hbase4.apache.org,35469,1689455451912)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689455551908.baaba897b46fc91caa1d8351dc0fc1e2.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,707 DEBUG [rs(jenkins-hbase4.apache.org,35469,1689455451912)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 21:12:32,707 DEBUG [rs(jenkins-hbase4.apache.org,35469,1689455451912)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 21:12:32,707 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 21:12:32,731 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689455551908.f922a161a593f2e1090cf0e39659530b. completed. 2023-07-15 21:12:32,731 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689455551908.f922a161a593f2e1090cf0e39659530b. 2023-07-15 21:12:32,735 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 21:12:32,735 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 21:12:32,735 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:32,735 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-15 21:12:32,735 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44797,1689455451778' in zk 2023-07-15 21:12:32,737 DEBUG [rs(jenkins-hbase4.apache.org,35469,1689455451912)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689455551908.baaba897b46fc91caa1d8351dc0fc1e2. completed. 2023-07-15 21:12:32,737 DEBUG [rs(jenkins-hbase4.apache.org,35469,1689455451912)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689455551908.baaba897b46fc91caa1d8351dc0fc1e2. 2023-07-15 21:12:32,737 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 21:12:32,737 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 21:12:32,737 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:32,737 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-15 21:12:32,737 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35469,1689455451912' in zk 2023-07-15 21:12:32,737 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-15 21:12:32,737 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:32,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:32,737 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:12:32,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:12:32,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:12:32,738 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-15 21:12:32,739 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:32,739 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-15 21:12:32,739 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:12:32,739 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-15 21:12:32,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:12:32,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:12:32,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:32,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:32,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:32,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:12:32,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:32,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:32,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:32,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,44797,1689455451778': 2023-07-15 21:12:32,744 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44797,1689455451778' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-15 21:12:32,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:32,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:12:32,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:12:32,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:12:32,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:12:32,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:32,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:32,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:32,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:12:32,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:32,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:32,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:32,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,35469,1689455451912': 2023-07-15 21:12:32,747 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35469,1689455451912' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-15 21:12:32,747 INFO [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-15 21:12:32,748 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 21:12:32,748 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 21:12:32,748 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,748 INFO [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 21:12:32,749 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,749 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,749 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:32,749 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,749 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:12:32,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:12:32,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,750 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:32,749 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:32,750 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,750 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:32,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,750 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:32,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:12:32,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:32,750 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:32,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:32,750 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:32,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:32,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:32,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,751 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:32,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:12:32,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:32,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:32,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:32,754 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:32,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:12:32,754 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:32,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,754 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:32,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:32,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:32,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:32,758 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:32,758 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:32,758 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:32,758 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:32,758 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:12:32,758 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,758 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:32,758 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:32,758 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:32,758 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:32,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:32,760 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,760 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:32,758 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:32,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:32,760 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:32,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:32,760 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:32,761 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,761 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:32,761 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,761 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:32,761 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:32,761 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,761 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,761 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:32,761 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:32,761 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:32,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:32,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:32,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:32,763 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,811 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,869 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-15 21:12:32,869 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,870 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,870 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689455552582Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689455552760 (+178 ms)Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689455552760Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689455552768 (+8 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689455552800 (+32 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689455552869 (+69 ms) 2023-07-15 21:12:32,875 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-15 21:12:32,879 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 292 msec 2023-07-15 21:12:32,893 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 21:12:32,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 21:12:32,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 21:12:32,900 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44797] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689455551908.f922a161a593f2e1090cf0e39659530b. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 21:12:32,902 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35469] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689455551908.baaba897b46fc91caa1d8351dc0fc1e2. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 21:12:32,905 DEBUG [Listener at jenkins-hbase4.apache.org/44607] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-15 21:12:32,905 DEBUG [Listener at jenkins-hbase4.apache.org/44607] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689455551908.f922a161a593f2e1090cf0e39659530b. 2023-07-15 21:12:32,905 INFO [Listener at jenkins-hbase4.apache.org/44607] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 21:12:32,918 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 21:12:32,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689455552918 (current time:1689455552918). 2023-07-15 21:12:32,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 21:12:32,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] zookeeper.ReadOnlyZKClient(139): Connect 0x55e1b784 to 127.0.0.1:57175 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 21:12:32,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3a88ea99, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 21:12:32,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:12:32,932 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38578, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:12:32,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x55e1b784 to 127.0.0.1:57175 2023-07-15 21:12:32,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 21:12:32,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] zookeeper.ReadOnlyZKClient(139): Connect 0x00501741 to 127.0.0.1:57175 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 21:12:32,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@58d5cd58, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 21:12:32,948 DEBUG [hconnection-0x25f438f9-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:12:32,949 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38586, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:12:32,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:12:32,955 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44192, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:12:32,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x00501741 to 127.0.0.1:57175 2023-07-15 21:12:32,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 21:12:32,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-15 21:12:32,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 21:12:32,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 21:12:32,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-15 21:12:32,960 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-15 21:12:32,961 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689456152961 2023-07-15 21:12:32,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 21:12:32,961 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-15 21:12:32,962 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 21:12:32,963 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 21:12:32,966 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-15 21:12:32,966 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-15 21:12:32,967 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-15 21:12:32,968 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-15 21:12:32,969 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689456152969 2023-07-15 21:12:32,985 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,985 INFO [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-15 21:12:32,985 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:12:32,987 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-15 21:12:32,987 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-15 21:12:32,988 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,988 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,990 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:32,990 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:32,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:32,990 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:32,990 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:32,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:32,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:32,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:32,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:32,990 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:32,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:32,990 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:32,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,991 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,991 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,991 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:32,991 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 21:12:32,991 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-15 21:12:32,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-15 21:12:32,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,992 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-15 21:12:32,992 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-15 21:12:32,992 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,992 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-15 21:12:32,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,992 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-15 21:12:32,992 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-15 21:12:32,992 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-15 21:12:32,992 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:12:32,992 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:12:32,994 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-15 21:12:32,994 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-15 21:12:32,994 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:32,995 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-15 21:12:32,995 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-15 21:12:32,995 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44797,1689455451778' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-15 21:12:32,994 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38601,1689455451863' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-15 21:12:32,995 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-15 21:12:32,995 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:12:32,999 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-15 21:12:32,999 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-15 21:12:32,999 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35469,1689455451912' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-15 21:12:33,000 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:33,000 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:33,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:12:33,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:12:33,001 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:33,001 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:12:33,001 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,001 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,001 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:12:33,002 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,002 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:12:33,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:12:33,002 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,002 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:12:33,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:33,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:33,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:33,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:12:33,003 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44797,1689455451778' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-15 21:12:33,003 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@189488c1[Count = 1] remaining members to acquire global barrier 2023-07-15 21:12:33,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:33,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:12:33,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:12:33,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:12:33,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:12:33,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:33,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:33,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:33,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:12:33,005 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35469,1689455451912' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-15 21:12:33,005 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@189488c1[Count = 0] remaining members to acquire global barrier 2023-07-15 21:12:33,005 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-15 21:12:33,005 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,016 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,016 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,016 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,016 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,016 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,016 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,016 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:33,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,016 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-15 21:12:33,016 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-15 21:12:33,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,017 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 21:12:33,017 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 21:12:33,017 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-15 21:12:33,017 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:33,017 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 21:12:33,017 DEBUG [rs(jenkins-hbase4.apache.org,35469,1689455451912)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689455551908.baaba897b46fc91caa1d8351dc0fc1e2. 2023-07-15 21:12:33,017 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689455551908.f922a161a593f2e1090cf0e39659530b. 2023-07-15 21:12:33,017 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 21:12:33,017 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 21:12:33,017 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689455551908.f922a161a593f2e1090cf0e39659530b. started... 2023-07-15 21:12:33,017 DEBUG [rs(jenkins-hbase4.apache.org,35469,1689455451912)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689455551908.baaba897b46fc91caa1d8351dc0fc1e2. started... 2023-07-15 21:12:33,017 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-15 21:12:33,017 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,38601,1689455451863' in zk 2023-07-15 21:12:33,017 INFO [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f922a161a593f2e1090cf0e39659530b 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-15 21:12:33,017 INFO [rs(jenkins-hbase4.apache.org,35469,1689455451912)-snapshot-pool-0] regionserver.HRegion(2745): Flushing baaba897b46fc91caa1d8351dc0fc1e2 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-15 21:12:33,019 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-15 21:12:33,019 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:12:33,019 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-15 21:12:33,063 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 21:12:33,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 21:12:33,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-15 21:12:33,067 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 21:12:33,079 INFO [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=266 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testEmptyExportFileSystemState/f922a161a593f2e1090cf0e39659530b/.tmp/cf/7df1706f09224049974518b24f7e40c3 2023-07-15 21:12:33,082 INFO [rs(jenkins-hbase4.apache.org,35469,1689455451912)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.00 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testEmptyExportFileSystemState/baaba897b46fc91caa1d8351dc0fc1e2/.tmp/cf/5d7adee071d241c282f66d9eb9f36998 2023-07-15 21:12:33,087 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testEmptyExportFileSystemState/f922a161a593f2e1090cf0e39659530b/.tmp/cf/7df1706f09224049974518b24f7e40c3 as hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testEmptyExportFileSystemState/f922a161a593f2e1090cf0e39659530b/cf/7df1706f09224049974518b24f7e40c3 2023-07-15 21:12:33,088 DEBUG [rs(jenkins-hbase4.apache.org,35469,1689455451912)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testEmptyExportFileSystemState/baaba897b46fc91caa1d8351dc0fc1e2/.tmp/cf/5d7adee071d241c282f66d9eb9f36998 as hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testEmptyExportFileSystemState/baaba897b46fc91caa1d8351dc0fc1e2/cf/5d7adee071d241c282f66d9eb9f36998 2023-07-15 21:12:33,092 INFO [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testEmptyExportFileSystemState/f922a161a593f2e1090cf0e39659530b/cf/7df1706f09224049974518b24f7e40c3, entries=4, sequenceid=6, filesize=5.1 K 2023-07-15 21:12:33,093 INFO [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for f922a161a593f2e1090cf0e39659530b in 76ms, sequenceid=6, compaction requested=false 2023-07-15 21:12:33,093 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-15 21:12:33,094 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f922a161a593f2e1090cf0e39659530b: 2023-07-15 21:12:33,094 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689455551908.f922a161a593f2e1090cf0e39659530b.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,094 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 21:12:33,095 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testEmptyExportFileSystemState/f922a161a593f2e1090cf0e39659530b/cf/7df1706f09224049974518b24f7e40c3] hfiles 2023-07-15 21:12:33,095 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testEmptyExportFileSystemState/f922a161a593f2e1090cf0e39659530b/cf/7df1706f09224049974518b24f7e40c3 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,099 INFO [rs(jenkins-hbase4.apache.org,35469,1689455451912)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testEmptyExportFileSystemState/baaba897b46fc91caa1d8351dc0fc1e2/cf/5d7adee071d241c282f66d9eb9f36998, entries=46, sequenceid=6, filesize=7.9 K 2023-07-15 21:12:33,100 INFO [rs(jenkins-hbase4.apache.org,35469,1689455451912)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for baaba897b46fc91caa1d8351dc0fc1e2 in 83ms, sequenceid=6, compaction requested=false 2023-07-15 21:12:33,104 DEBUG [rs(jenkins-hbase4.apache.org,35469,1689455451912)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for baaba897b46fc91caa1d8351dc0fc1e2: 2023-07-15 21:12:33,104 DEBUG [rs(jenkins-hbase4.apache.org,35469,1689455451912)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689455551908.baaba897b46fc91caa1d8351dc0fc1e2.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,106 DEBUG [rs(jenkins-hbase4.apache.org,35469,1689455451912)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 21:12:33,106 DEBUG [rs(jenkins-hbase4.apache.org,35469,1689455451912)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testEmptyExportFileSystemState/baaba897b46fc91caa1d8351dc0fc1e2/cf/5d7adee071d241c282f66d9eb9f36998] hfiles 2023-07-15 21:12:33,106 DEBUG [rs(jenkins-hbase4.apache.org,35469,1689455451912)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testEmptyExportFileSystemState/baaba897b46fc91caa1d8351dc0fc1e2/cf/5d7adee071d241c282f66d9eb9f36998 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,162 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689455551908.f922a161a593f2e1090cf0e39659530b. completed. 2023-07-15 21:12:33,162 DEBUG [rs(jenkins-hbase4.apache.org,44797,1689455451778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689455551908.f922a161a593f2e1090cf0e39659530b. 2023-07-15 21:12:33,163 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 21:12:33,163 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 21:12:33,163 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:33,167 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-15 21:12:33,167 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44797,1689455451778' in zk 2023-07-15 21:12:33,169 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:33,169 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-15 21:12:33,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:33,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:12:33,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:12:33,169 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:12:33,169 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-15 21:12:33,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:12:33,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:12:33,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:33,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:33,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:33,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:12:33,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:33,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:33,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,44797,1689455451778': 2023-07-15 21:12:33,174 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44797,1689455451778' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-15 21:12:33,176 DEBUG [rs(jenkins-hbase4.apache.org,35469,1689455451912)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689455551908.baaba897b46fc91caa1d8351dc0fc1e2. completed. 2023-07-15 21:12:33,176 DEBUG [rs(jenkins-hbase4.apache.org,35469,1689455451912)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689455551908.baaba897b46fc91caa1d8351dc0fc1e2. 2023-07-15 21:12:33,176 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 21:12:33,176 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 21:12:33,176 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:33,176 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-15 21:12:33,176 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35469,1689455451912' in zk 2023-07-15 21:12:33,178 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:33,178 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-15 21:12:33,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:33,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:12:33,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:12:33,178 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:12:33,178 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-15 21:12:33,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:12:33,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:12:33,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:33,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:33,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:33,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:12:33,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:33,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:33,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:33,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,35469,1689455451912': 2023-07-15 21:12:33,184 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35469,1689455451912' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-15 21:12:33,184 INFO [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-15 21:12:33,184 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 21:12:33,184 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 21:12:33,184 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,184 INFO [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 21:12:33,190 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,190 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,190 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,190 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,190 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:33,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:12:33,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:12:33,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,190 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:33,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,190 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:33,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,191 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:33,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:12:33,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:33,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:33,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:33,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:33,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:33,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:33,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,191 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:33,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:12:33,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,192 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:33,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:33,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:33,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:33,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:12:33,194 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:33,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,194 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:33,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:33,195 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:33,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:33,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:33,198 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:33,198 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:33,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:33,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:33,198 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:33,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:33,198 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:33,198 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:33,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:33,198 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:33,198 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:33,198 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:33,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:33,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:33,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:33,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:33,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:33,198 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:33,198 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,199 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:33,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:33,198 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:12:33,199 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:33,199 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,201 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:33,201 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,201 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:33,201 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:33,201 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,201 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,201 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,261 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,270 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 21:12:33,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 21:12:33,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-15 21:12:33,272 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-15 21:12:33,305 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-15 21:12:33,305 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,306 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,306 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689455552961Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689455553199 (+238 ms)Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689455553199Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689455553206 (+7 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689455553241 (+35 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689455553305 (+64 ms) 2023-07-15 21:12:33,309 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-15 21:12:33,311 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 347 msec 2023-07-15 21:12:33,572 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 21:12:33,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 21:12:33,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 21:12:33,574 INFO [Listener at jenkins-hbase4.apache.org/44607] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/export-test/export-1689455553574 2023-07-15 21:12:33,574 INFO [Listener at jenkins-hbase4.apache.org/44607] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:45529, tgtDir=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/export-test/export-1689455553574, rawTgtDir=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/export-test/export-1689455553574, srcFsUri=hdfs://localhost:45529, srcDir=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f 2023-07-15 21:12:33,609 DEBUG [Listener at jenkins-hbase4.apache.org/44607] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45529, inputRoot=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f 2023-07-15 21:12:33,610 DEBUG [Listener at jenkins-hbase4.apache.org/44607] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1677731394_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/export-test/export-1689455553574, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/export-test/export-1689455553574/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,610 INFO [Listener at jenkins-hbase4.apache.org/44607] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45529, inputRoot=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f, snapshotDir=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-15 21:12:33,658 INFO [Listener at jenkins-hbase4.apache.org/44607] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/export-test/export-1689455553574/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,750 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:33,750 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:33,751 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:33,752 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:33,752 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:33,752 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:33,753 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:33,863 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/hadoop-8264707162744160422.jar 2023-07-15 21:12:33,863 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:33,864 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:33,864 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:33,865 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:33,865 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:33,866 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:33,866 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-15 21:12:33,867 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-15 21:12:33,867 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-15 21:12:33,868 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-15 21:12:33,868 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-15 21:12:33,869 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-15 21:12:33,869 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-15 21:12:33,870 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-15 21:12:33,870 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-15 21:12:33,871 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-15 21:12:33,872 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 21:12:33,872 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 21:12:33,873 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 21:12:33,873 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 21:12:33,874 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 21:12:33,875 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 21:12:33,875 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 21:12:35,115 WARN [Listener at jenkins-hbase4.apache.org/44607] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-15 21:12:35,117 INFO [Listener at jenkins-hbase4.apache.org/44607] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-15 21:12:35,388 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 21:12:35,388 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 21:12:35,392 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689455460014_0005_000001 (auth:SIMPLE) 2023-07-15 21:12:36,138 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689455460014_0006_000001 (auth:SIMPLE) 2023-07-15 21:12:36,794 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-15 21:12:42,109 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689455460014_0006_000001 (auth:SIMPLE) 2023-07-15 21:12:44,518 INFO [Listener at jenkins-hbase4.apache.org/44607] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-15 21:12:44,519 INFO [Listener at jenkins-hbase4.apache.org/44607] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-15 21:12:44,538 INFO [Listener at jenkins-hbase4.apache.org/44607] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:44,539 INFO [Listener at jenkins-hbase4.apache.org/44607] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-15 21:12:44,539 INFO [Listener at jenkins-hbase4.apache.org/44607] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-15 21:12:44,539 DEBUG [Listener at jenkins-hbase4.apache.org/44607] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_404915474_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:44,540 DEBUG [Listener at jenkins-hbase4.apache.org/44607] snapshot.TestExportSnapshot(367): hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-15 21:12:44,540 DEBUG [Listener at jenkins-hbase4.apache.org/44607] snapshot.TestExportSnapshot(367): hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-15 21:12:44,540 DEBUG [Listener at jenkins-hbase4.apache.org/44607] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_404915474_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/export-test/export-1689455553574/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/export-test/export-1689455553574/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:44,541 DEBUG [Listener at jenkins-hbase4.apache.org/44607] snapshot.TestExportSnapshot(367): hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/export-test/export-1689455553574/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-15 21:12:44,541 DEBUG [Listener at jenkins-hbase4.apache.org/44607] snapshot.TestExportSnapshot(367): hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/export-test/export-1689455553574/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-15 21:12:44,550 INFO [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-15 21:12:44,550 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-15 21:12:44,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-15 21:12:44,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-15 21:12:44,558 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689455564558"}]},"ts":"1689455564558"} 2023-07-15 21:12:44,560 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-15 21:12:44,562 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-15 21:12:44,563 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f922a161a593f2e1090cf0e39659530b, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=baaba897b46fc91caa1d8351dc0fc1e2, UNASSIGN}] 2023-07-15 21:12:44,566 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f922a161a593f2e1090cf0e39659530b, UNASSIGN 2023-07-15 21:12:44,566 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=baaba897b46fc91caa1d8351dc0fc1e2, UNASSIGN 2023-07-15 21:12:44,569 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=f922a161a593f2e1090cf0e39659530b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:44,569 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=baaba897b46fc91caa1d8351dc0fc1e2, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:44,570 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689455551908.f922a161a593f2e1090cf0e39659530b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689455564569"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689455564569"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689455564569"}]},"ts":"1689455564569"} 2023-07-15 21:12:44,570 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689455551908.baaba897b46fc91caa1d8351dc0fc1e2.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689455564569"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689455564569"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689455564569"}]},"ts":"1689455564569"} 2023-07-15 21:12:44,571 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure f922a161a593f2e1090cf0e39659530b, server=jenkins-hbase4.apache.org,44797,1689455451778}] 2023-07-15 21:12:44,573 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure baaba897b46fc91caa1d8351dc0fc1e2, server=jenkins-hbase4.apache.org,35469,1689455451912}] 2023-07-15 21:12:44,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-15 21:12:44,724 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f922a161a593f2e1090cf0e39659530b 2023-07-15 21:12:44,724 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f922a161a593f2e1090cf0e39659530b, disabling compactions & flushes 2023-07-15 21:12:44,725 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689455551908.f922a161a593f2e1090cf0e39659530b. 2023-07-15 21:12:44,725 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689455551908.f922a161a593f2e1090cf0e39659530b. 2023-07-15 21:12:44,725 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689455551908.f922a161a593f2e1090cf0e39659530b. after waiting 0 ms 2023-07-15 21:12:44,725 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689455551908.f922a161a593f2e1090cf0e39659530b. 2023-07-15 21:12:44,729 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close baaba897b46fc91caa1d8351dc0fc1e2 2023-07-15 21:12:44,730 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing baaba897b46fc91caa1d8351dc0fc1e2, disabling compactions & flushes 2023-07-15 21:12:44,730 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689455551908.baaba897b46fc91caa1d8351dc0fc1e2. 2023-07-15 21:12:44,730 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689455551908.baaba897b46fc91caa1d8351dc0fc1e2. 2023-07-15 21:12:44,730 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689455551908.baaba897b46fc91caa1d8351dc0fc1e2. after waiting 0 ms 2023-07-15 21:12:44,730 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689455551908.baaba897b46fc91caa1d8351dc0fc1e2. 2023-07-15 21:12:44,778 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testEmptyExportFileSystemState/f922a161a593f2e1090cf0e39659530b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 21:12:44,778 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 21:12:44,781 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689455551908.f922a161a593f2e1090cf0e39659530b. 2023-07-15 21:12:44,781 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f922a161a593f2e1090cf0e39659530b: 2023-07-15 21:12:44,783 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testEmptyExportFileSystemState/baaba897b46fc91caa1d8351dc0fc1e2/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 21:12:44,785 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f922a161a593f2e1090cf0e39659530b 2023-07-15 21:12:44,785 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=f922a161a593f2e1090cf0e39659530b, regionState=CLOSED 2023-07-15 21:12:44,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 21:12:44,786 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689455551908.f922a161a593f2e1090cf0e39659530b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689455564785"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689455564785"}]},"ts":"1689455564785"} 2023-07-15 21:12:44,787 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689455551908.baaba897b46fc91caa1d8351dc0fc1e2. 2023-07-15 21:12:44,787 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for baaba897b46fc91caa1d8351dc0fc1e2: 2023-07-15 21:12:44,790 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed baaba897b46fc91caa1d8351dc0fc1e2 2023-07-15 21:12:44,791 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=baaba897b46fc91caa1d8351dc0fc1e2, regionState=CLOSED 2023-07-15 21:12:44,792 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689455551908.baaba897b46fc91caa1d8351dc0fc1e2.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689455564791"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689455564791"}]},"ts":"1689455564791"} 2023-07-15 21:12:44,793 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-07-15 21:12:44,793 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure f922a161a593f2e1090cf0e39659530b, server=jenkins-hbase4.apache.org,44797,1689455451778 in 219 msec 2023-07-15 21:12:44,794 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f922a161a593f2e1090cf0e39659530b, UNASSIGN in 230 msec 2023-07-15 21:12:44,795 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=101 2023-07-15 21:12:44,795 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure baaba897b46fc91caa1d8351dc0fc1e2, server=jenkins-hbase4.apache.org,35469,1689455451912 in 220 msec 2023-07-15 21:12:44,796 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-07-15 21:12:44,796 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=baaba897b46fc91caa1d8351dc0fc1e2, UNASSIGN in 232 msec 2023-07-15 21:12:44,797 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689455564797"}]},"ts":"1689455564797"} 2023-07-15 21:12:44,798 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-15 21:12:44,800 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-15 21:12:44,802 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 249 msec 2023-07-15 21:12:44,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-15 21:12:44,864 INFO [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-15 21:12:44,865 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-15 21:12:44,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-15 21:12:44,869 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-15 21:12:44,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-15 21:12:44,870 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-15 21:12:44,872 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35469] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-15 21:12:44,876 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-15 21:12:44,876 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-15 21:12:44,876 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-15 21:12:44,876 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-15 21:12:44,876 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-15 21:12:44,877 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-15 21:12:44,877 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-15 21:12:44,877 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-15 21:12:44,878 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-15 21:12:44,878 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-15 21:12:44,878 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:12:44,878 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-15 21:12:44,878 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-15 21:12:44,878 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:12:44,878 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:12:44,878 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:12:44,880 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testEmptyExportFileSystemState/baaba897b46fc91caa1d8351dc0fc1e2 2023-07-15 21:12:44,880 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testEmptyExportFileSystemState/f922a161a593f2e1090cf0e39659530b 2023-07-15 21:12:44,882 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testEmptyExportFileSystemState/baaba897b46fc91caa1d8351dc0fc1e2/cf, FileablePath, hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testEmptyExportFileSystemState/baaba897b46fc91caa1d8351dc0fc1e2/recovered.edits] 2023-07-15 21:12:44,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-15 21:12:44,888 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testEmptyExportFileSystemState/f922a161a593f2e1090cf0e39659530b/cf, FileablePath, hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testEmptyExportFileSystemState/f922a161a593f2e1090cf0e39659530b/recovered.edits] 2023-07-15 21:12:44,891 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testEmptyExportFileSystemState/baaba897b46fc91caa1d8351dc0fc1e2/cf/5d7adee071d241c282f66d9eb9f36998 to hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/archive/data/default/testtb-testEmptyExportFileSystemState/baaba897b46fc91caa1d8351dc0fc1e2/cf/5d7adee071d241c282f66d9eb9f36998 2023-07-15 21:12:44,893 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testEmptyExportFileSystemState/f922a161a593f2e1090cf0e39659530b/cf/7df1706f09224049974518b24f7e40c3 to hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/archive/data/default/testtb-testEmptyExportFileSystemState/f922a161a593f2e1090cf0e39659530b/cf/7df1706f09224049974518b24f7e40c3 2023-07-15 21:12:44,895 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testEmptyExportFileSystemState/baaba897b46fc91caa1d8351dc0fc1e2/recovered.edits/9.seqid to hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/archive/data/default/testtb-testEmptyExportFileSystemState/baaba897b46fc91caa1d8351dc0fc1e2/recovered.edits/9.seqid 2023-07-15 21:12:44,896 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testEmptyExportFileSystemState/baaba897b46fc91caa1d8351dc0fc1e2 2023-07-15 21:12:44,898 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testEmptyExportFileSystemState/f922a161a593f2e1090cf0e39659530b/recovered.edits/9.seqid to hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/archive/data/default/testtb-testEmptyExportFileSystemState/f922a161a593f2e1090cf0e39659530b/recovered.edits/9.seqid 2023-07-15 21:12:44,899 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testEmptyExportFileSystemState/f922a161a593f2e1090cf0e39659530b 2023-07-15 21:12:44,899 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-15 21:12:44,901 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-15 21:12:44,904 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-15 21:12:44,906 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-15 21:12:44,907 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-15 21:12:44,907 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-15 21:12:44,907 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689455551908.f922a161a593f2e1090cf0e39659530b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689455564907"}]},"ts":"9223372036854775807"} 2023-07-15 21:12:44,907 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689455551908.baaba897b46fc91caa1d8351dc0fc1e2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689455564907"}]},"ts":"9223372036854775807"} 2023-07-15 21:12:44,909 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-15 21:12:44,909 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => f922a161a593f2e1090cf0e39659530b, NAME => 'testtb-testEmptyExportFileSystemState,,1689455551908.f922a161a593f2e1090cf0e39659530b.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => baaba897b46fc91caa1d8351dc0fc1e2, NAME => 'testtb-testEmptyExportFileSystemState,1,1689455551908.baaba897b46fc91caa1d8351dc0fc1e2.', STARTKEY => '1', ENDKEY => ''}] 2023-07-15 21:12:44,909 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-15 21:12:44,909 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689455564909"}]},"ts":"9223372036854775807"} 2023-07-15 21:12:44,911 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-15 21:12:44,913 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-15 21:12:44,914 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 48 msec 2023-07-15 21:12:44,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-15 21:12:44,984 INFO [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-15 21:12:44,997 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-15 21:12:44,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:45,001 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-15 21:12:45,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:45,036 INFO [Listener at jenkins-hbase4.apache.org/44607] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=765 (was 760) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-493449779_1 at /127.0.0.1:60990 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7100f96f-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1488416207) connection to jenkins-hbase4.apache.org/172.31.14.131:37377 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x7100f96f-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-493449779_1 at /127.0.0.1:43502 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_404915474_17 at /127.0.0.1:38944 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4602 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: IPC Client (1488416207) connection to jenkins-hbase4.apache.org/172.31.14.131:41365 from appattempt_1689455460014_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_404915474_17 at /127.0.0.1:43516 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_404915474_17 at /127.0.0.1:32782 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1488416207) connection to jenkins-hbase4.apache.org/172.31.14.131:45609 from appattempt_1689455460014_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x7100f96f-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7100f96f-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=927 (was 908) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=581 (was 486) - SystemLoadAverage LEAK? -, ProcessCount=182 (was 182), AvailableMemoryMB=2083 (was 2207) 2023-07-15 21:12:45,036 WARN [Listener at jenkins-hbase4.apache.org/44607] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-07-15 21:12:45,066 INFO [Listener at jenkins-hbase4.apache.org/44607] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=765, OpenFileDescriptor=927, MaxFileDescriptor=60000, SystemLoadAverage=581, ProcessCount=182, AvailableMemoryMB=2081 2023-07-15 21:12:45,067 WARN [Listener at jenkins-hbase4.apache.org/44607] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-07-15 21:12:45,068 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-15 21:12:45,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:45,072 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 21:12:45,073 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-15 21:12:45,074 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 21:12:45,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-15 21:12:45,076 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/939a01b8e1f31ba28ad746d8f9e61a3a 2023-07-15 21:12:45,076 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7317fa4ac99edd1952550818b153d1aa 2023-07-15 21:12:45,077 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/939a01b8e1f31ba28ad746d8f9e61a3a empty. 2023-07-15 21:12:45,077 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7317fa4ac99edd1952550818b153d1aa empty. 2023-07-15 21:12:45,077 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/939a01b8e1f31ba28ad746d8f9e61a3a 2023-07-15 21:12:45,077 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7317fa4ac99edd1952550818b153d1aa 2023-07-15 21:12:45,077 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-15 21:12:45,095 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-15 21:12:45,096 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 939a01b8e1f31ba28ad746d8f9e61a3a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689455565068.939a01b8e1f31ba28ad746d8f9e61a3a.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp 2023-07-15 21:12:45,101 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 7317fa4ac99edd1952550818b153d1aa, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689455565068.7317fa4ac99edd1952550818b153d1aa.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp 2023-07-15 21:12:45,133 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689455565068.939a01b8e1f31ba28ad746d8f9e61a3a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:12:45,133 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 939a01b8e1f31ba28ad746d8f9e61a3a, disabling compactions & flushes 2023-07-15 21:12:45,133 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689455565068.939a01b8e1f31ba28ad746d8f9e61a3a. 2023-07-15 21:12:45,133 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689455565068.939a01b8e1f31ba28ad746d8f9e61a3a. 2023-07-15 21:12:45,133 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689455565068.939a01b8e1f31ba28ad746d8f9e61a3a. after waiting 0 ms 2023-07-15 21:12:45,134 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689455565068.939a01b8e1f31ba28ad746d8f9e61a3a. 2023-07-15 21:12:45,134 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689455565068.939a01b8e1f31ba28ad746d8f9e61a3a. 2023-07-15 21:12:45,134 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 939a01b8e1f31ba28ad746d8f9e61a3a: 2023-07-15 21:12:45,141 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689455565068.7317fa4ac99edd1952550818b153d1aa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:12:45,141 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 7317fa4ac99edd1952550818b153d1aa, disabling compactions & flushes 2023-07-15 21:12:45,141 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689455565068.7317fa4ac99edd1952550818b153d1aa. 2023-07-15 21:12:45,141 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689455565068.7317fa4ac99edd1952550818b153d1aa. 2023-07-15 21:12:45,141 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689455565068.7317fa4ac99edd1952550818b153d1aa. after waiting 0 ms 2023-07-15 21:12:45,141 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689455565068.7317fa4ac99edd1952550818b153d1aa. 2023-07-15 21:12:45,141 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689455565068.7317fa4ac99edd1952550818b153d1aa. 2023-07-15 21:12:45,141 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 7317fa4ac99edd1952550818b153d1aa: 2023-07-15 21:12:45,145 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 21:12:45,147 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689455565068.939a01b8e1f31ba28ad746d8f9e61a3a.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689455565147"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689455565147"}]},"ts":"1689455565147"} 2023-07-15 21:12:45,147 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689455565068.7317fa4ac99edd1952550818b153d1aa.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689455565147"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689455565147"}]},"ts":"1689455565147"} 2023-07-15 21:12:45,162 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-15 21:12:45,163 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 21:12:45,163 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689455565163"}]},"ts":"1689455565163"} 2023-07-15 21:12:45,164 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-15 21:12:45,168 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 21:12:45,170 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 21:12:45,170 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 21:12:45,170 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 21:12:45,170 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 21:12:45,170 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=939a01b8e1f31ba28ad746d8f9e61a3a, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=7317fa4ac99edd1952550818b153d1aa, ASSIGN}] 2023-07-15 21:12:45,174 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=7317fa4ac99edd1952550818b153d1aa, ASSIGN 2023-07-15 21:12:45,174 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=939a01b8e1f31ba28ad746d8f9e61a3a, ASSIGN 2023-07-15 21:12:45,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-15 21:12:45,175 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=7317fa4ac99edd1952550818b153d1aa, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38601,1689455451863; forceNewPlan=false, retain=false 2023-07-15 21:12:45,175 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=939a01b8e1f31ba28ad746d8f9e61a3a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35469,1689455451912; forceNewPlan=false, retain=false 2023-07-15 21:12:45,325 INFO [jenkins-hbase4:44929] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-15 21:12:45,329 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=7317fa4ac99edd1952550818b153d1aa, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:45,329 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689455565068.7317fa4ac99edd1952550818b153d1aa.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689455565329"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689455565329"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689455565329"}]},"ts":"1689455565329"} 2023-07-15 21:12:45,329 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=939a01b8e1f31ba28ad746d8f9e61a3a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:45,329 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689455565068.939a01b8e1f31ba28ad746d8f9e61a3a.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689455565329"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689455565329"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689455565329"}]},"ts":"1689455565329"} 2023-07-15 21:12:45,331 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure 7317fa4ac99edd1952550818b153d1aa, server=jenkins-hbase4.apache.org,38601,1689455451863}] 2023-07-15 21:12:45,334 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure 939a01b8e1f31ba28ad746d8f9e61a3a, server=jenkins-hbase4.apache.org,35469,1689455451912}] 2023-07-15 21:12:45,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-15 21:12:45,491 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689455565068.939a01b8e1f31ba28ad746d8f9e61a3a. 2023-07-15 21:12:45,491 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 939a01b8e1f31ba28ad746d8f9e61a3a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689455565068.939a01b8e1f31ba28ad746d8f9e61a3a.', STARTKEY => '', ENDKEY => '1'} 2023-07-15 21:12:45,492 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689455565068.7317fa4ac99edd1952550818b153d1aa. 2023-07-15 21:12:45,492 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689455565068.939a01b8e1f31ba28ad746d8f9e61a3a. service=AccessControlService 2023-07-15 21:12:45,492 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7317fa4ac99edd1952550818b153d1aa, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689455565068.7317fa4ac99edd1952550818b153d1aa.', STARTKEY => '1', ENDKEY => ''} 2023-07-15 21:12:45,492 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 21:12:45,492 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689455565068.7317fa4ac99edd1952550818b153d1aa. service=AccessControlService 2023-07-15 21:12:45,492 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 939a01b8e1f31ba28ad746d8f9e61a3a 2023-07-15 21:12:45,492 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689455565068.939a01b8e1f31ba28ad746d8f9e61a3a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:12:45,492 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 21:12:45,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 939a01b8e1f31ba28ad746d8f9e61a3a 2023-07-15 21:12:45,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 7317fa4ac99edd1952550818b153d1aa 2023-07-15 21:12:45,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 939a01b8e1f31ba28ad746d8f9e61a3a 2023-07-15 21:12:45,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689455565068.7317fa4ac99edd1952550818b153d1aa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:12:45,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7317fa4ac99edd1952550818b153d1aa 2023-07-15 21:12:45,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7317fa4ac99edd1952550818b153d1aa 2023-07-15 21:12:45,494 INFO [StoreOpener-7317fa4ac99edd1952550818b153d1aa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7317fa4ac99edd1952550818b153d1aa 2023-07-15 21:12:45,494 INFO [StoreOpener-939a01b8e1f31ba28ad746d8f9e61a3a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 939a01b8e1f31ba28ad746d8f9e61a3a 2023-07-15 21:12:45,499 DEBUG [StoreOpener-939a01b8e1f31ba28ad746d8f9e61a3a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithSkipTmp/939a01b8e1f31ba28ad746d8f9e61a3a/cf 2023-07-15 21:12:45,499 DEBUG [StoreOpener-7317fa4ac99edd1952550818b153d1aa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithSkipTmp/7317fa4ac99edd1952550818b153d1aa/cf 2023-07-15 21:12:45,499 DEBUG [StoreOpener-7317fa4ac99edd1952550818b153d1aa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithSkipTmp/7317fa4ac99edd1952550818b153d1aa/cf 2023-07-15 21:12:45,499 DEBUG [StoreOpener-939a01b8e1f31ba28ad746d8f9e61a3a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithSkipTmp/939a01b8e1f31ba28ad746d8f9e61a3a/cf 2023-07-15 21:12:45,499 INFO [StoreOpener-7317fa4ac99edd1952550818b153d1aa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7317fa4ac99edd1952550818b153d1aa columnFamilyName cf 2023-07-15 21:12:45,499 INFO [StoreOpener-939a01b8e1f31ba28ad746d8f9e61a3a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 939a01b8e1f31ba28ad746d8f9e61a3a columnFamilyName cf 2023-07-15 21:12:45,500 INFO [StoreOpener-7317fa4ac99edd1952550818b153d1aa-1] regionserver.HStore(310): Store=7317fa4ac99edd1952550818b153d1aa/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 21:12:45,500 INFO [StoreOpener-939a01b8e1f31ba28ad746d8f9e61a3a-1] regionserver.HStore(310): Store=939a01b8e1f31ba28ad746d8f9e61a3a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 21:12:45,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithSkipTmp/7317fa4ac99edd1952550818b153d1aa 2023-07-15 21:12:45,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithSkipTmp/939a01b8e1f31ba28ad746d8f9e61a3a 2023-07-15 21:12:45,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithSkipTmp/7317fa4ac99edd1952550818b153d1aa 2023-07-15 21:12:45,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithSkipTmp/939a01b8e1f31ba28ad746d8f9e61a3a 2023-07-15 21:12:45,504 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7317fa4ac99edd1952550818b153d1aa 2023-07-15 21:12:45,507 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 939a01b8e1f31ba28ad746d8f9e61a3a 2023-07-15 21:12:45,507 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithSkipTmp/7317fa4ac99edd1952550818b153d1aa/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 21:12:45,509 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7317fa4ac99edd1952550818b153d1aa; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67114517, jitterRate=8.42362642288208E-5}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 21:12:45,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7317fa4ac99edd1952550818b153d1aa: 2023-07-15 21:12:45,510 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689455565068.7317fa4ac99edd1952550818b153d1aa., pid=108, masterSystemTime=1689455565483 2023-07-15 21:12:45,510 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithSkipTmp/939a01b8e1f31ba28ad746d8f9e61a3a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 21:12:45,511 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 939a01b8e1f31ba28ad746d8f9e61a3a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62032316, jitterRate=-0.07564646005630493}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 21:12:45,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 939a01b8e1f31ba28ad746d8f9e61a3a: 2023-07-15 21:12:45,512 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689455565068.939a01b8e1f31ba28ad746d8f9e61a3a., pid=109, masterSystemTime=1689455565487 2023-07-15 21:12:45,512 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689455565068.7317fa4ac99edd1952550818b153d1aa. 2023-07-15 21:12:45,512 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689455565068.7317fa4ac99edd1952550818b153d1aa. 2023-07-15 21:12:45,512 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=7317fa4ac99edd1952550818b153d1aa, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:45,512 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689455565068.7317fa4ac99edd1952550818b153d1aa.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689455565512"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689455565512"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689455565512"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689455565512"}]},"ts":"1689455565512"} 2023-07-15 21:12:45,515 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689455565068.939a01b8e1f31ba28ad746d8f9e61a3a. 2023-07-15 21:12:45,515 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689455565068.939a01b8e1f31ba28ad746d8f9e61a3a. 2023-07-15 21:12:45,515 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=939a01b8e1f31ba28ad746d8f9e61a3a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:45,516 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689455565068.939a01b8e1f31ba28ad746d8f9e61a3a.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689455565515"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689455565515"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689455565515"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689455565515"}]},"ts":"1689455565515"} 2023-07-15 21:12:45,518 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=107 2023-07-15 21:12:45,518 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure 7317fa4ac99edd1952550818b153d1aa, server=jenkins-hbase4.apache.org,38601,1689455451863 in 184 msec 2023-07-15 21:12:45,519 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=7317fa4ac99edd1952550818b153d1aa, ASSIGN in 348 msec 2023-07-15 21:12:45,519 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=106 2023-07-15 21:12:45,519 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure 939a01b8e1f31ba28ad746d8f9e61a3a, server=jenkins-hbase4.apache.org,35469,1689455451912 in 183 msec 2023-07-15 21:12:45,521 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=106, resume processing ppid=105 2023-07-15 21:12:45,521 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=939a01b8e1f31ba28ad746d8f9e61a3a, ASSIGN in 349 msec 2023-07-15 21:12:45,522 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 21:12:45,522 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689455565522"}]},"ts":"1689455565522"} 2023-07-15 21:12:45,524 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-15 21:12:45,527 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 21:12:45,527 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-15 21:12:45,531 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35469] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-15 21:12:45,533 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:12:45,533 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:12:45,533 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:12:45,533 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:12:45,535 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-15 21:12:45,535 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-15 21:12:45,535 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-15 21:12:45,535 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-15 21:12:45,538 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 467 msec 2023-07-15 21:12:45,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-15 21:12:45,678 INFO [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-15 21:12:45,678 DEBUG [Listener at jenkins-hbase4.apache.org/44607] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithSkipTmp get assigned. Timeout = 60000ms 2023-07-15 21:12:45,679 INFO [Listener at jenkins-hbase4.apache.org/44607] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 21:12:45,683 INFO [Listener at jenkins-hbase4.apache.org/44607] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned to meta. Checking AM states. 2023-07-15 21:12:45,683 INFO [Listener at jenkins-hbase4.apache.org/44607] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 21:12:45,683 INFO [Listener at jenkins-hbase4.apache.org/44607] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned. 2023-07-15 21:12:45,687 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-15 21:12:45,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689455565687 (current time:1689455565687). 2023-07-15 21:12:45,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 21:12:45,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] zookeeper.ReadOnlyZKClient(139): Connect 0x36188b7c to 127.0.0.1:57175 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 21:12:45,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@11a9a85d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 21:12:45,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:12:45,720 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39500, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:12:45,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x36188b7c to 127.0.0.1:57175 2023-07-15 21:12:45,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 21:12:45,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] zookeeper.ReadOnlyZKClient(139): Connect 0x1fb8d5c0 to 127.0.0.1:57175 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 21:12:45,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6d09ee20, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 21:12:45,751 DEBUG [hconnection-0x31be489c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:12:45,755 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39504, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:12:45,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:12:45,764 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33438, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:12:45,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1fb8d5c0 to 127.0.0.1:57175 2023-07-15 21:12:45,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 21:12:45,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-15 21:12:45,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 21:12:45,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-15 21:12:45,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-15 21:12:45,776 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-15 21:12:45,777 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689456165777 2023-07-15 21:12:45,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-15 21:12:45,777 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:45,777 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 21:12:45,781 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 21:12:45,782 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-15 21:12:45,785 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-15 21:12:45,789 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 17 msec 2023-07-15 21:12:45,794 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-15 21:12:45,796 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689456165796 2023-07-15 21:12:45,846 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:45,846 INFO [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-15 21:12:45,846 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:12:45,849 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-15 21:12:45,849 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-15 21:12:45,850 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:45,850 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:45,851 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:45,851 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:45,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:45,851 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:45,851 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:45,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:45,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:45,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:45,852 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:45,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:45,852 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:45,852 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:45,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:45,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:45,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:45,853 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:45,853 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 21:12:45,853 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:45,853 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:45,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-15 21:12:45,853 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:45,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-15 21:12:45,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:45,854 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-15 21:12:45,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:45,854 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-15 21:12:45,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-15 21:12:45,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:45,855 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:45,854 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:45,855 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-15 21:12:45,855 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-15 21:12:45,855 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-15 21:12:45,855 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:12:45,855 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:12:45,860 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-15 21:12:45,860 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-15 21:12:45,860 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-15 21:12:45,860 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:45,860 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-15 21:12:45,860 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-15 21:12:45,860 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:12:45,860 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35469,1689455451912' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-15 21:12:45,862 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-15 21:12:45,862 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-15 21:12:45,860 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38601,1689455451863' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-15 21:12:45,862 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44797,1689455451778' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-15 21:12:45,866 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:45,866 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:45,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:45,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:12:45,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:12:45,866 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:45,867 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:45,867 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:45,867 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:12:45,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:12:45,868 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:45,868 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:12:45,868 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:45,868 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:45,868 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:12:45,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:12:45,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:45,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:45,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:45,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:45,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:12:45,871 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38601,1689455451863' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-15 21:12:45,871 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7fee720b[Count = 1] remaining members to acquire global barrier 2023-07-15 21:12:45,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:45,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:12:45,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:12:45,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:12:45,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:12:45,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:45,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:45,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:45,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:45,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:12:45,877 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35469,1689455451912' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-15 21:12:45,877 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7fee720b[Count = 0] remaining members to acquire global barrier 2023-07-15 21:12:45,877 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-15 21:12:45,877 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:45,878 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:45,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:45,879 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:45,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:45,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:45,879 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-15 21:12:45,879 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-15 21:12:45,879 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:45,879 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,44797,1689455451778' in zk 2023-07-15 21:12:45,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:45,879 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-15 21:12:45,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:45,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:45,879 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-15 21:12:45,881 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 21:12:45,882 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 21:12:45,882 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 21:12:45,882 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 21:12:45,882 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689455565068.7317fa4ac99edd1952550818b153d1aa. 2023-07-15 21:12:45,882 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 21:12:45,882 DEBUG [rs(jenkins-hbase4.apache.org,35469,1689455451912)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689455565068.939a01b8e1f31ba28ad746d8f9e61a3a. 2023-07-15 21:12:45,882 DEBUG [rs(jenkins-hbase4.apache.org,35469,1689455451912)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689455565068.939a01b8e1f31ba28ad746d8f9e61a3a. started... 2023-07-15 21:12:45,882 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689455565068.7317fa4ac99edd1952550818b153d1aa. started... 2023-07-15 21:12:45,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-15 21:12:45,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-15 21:12:45,885 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7317fa4ac99edd1952550818b153d1aa: 2023-07-15 21:12:45,885 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 21:12:45,885 DEBUG [rs(jenkins-hbase4.apache.org,35469,1689455451912)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 939a01b8e1f31ba28ad746d8f9e61a3a: 2023-07-15 21:12:45,885 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689455565068.7317fa4ac99edd1952550818b153d1aa.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:45,885 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 21:12:45,885 DEBUG [rs(jenkins-hbase4.apache.org,35469,1689455451912)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689455565068.939a01b8e1f31ba28ad746d8f9e61a3a.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:45,885 DEBUG [rs(jenkins-hbase4.apache.org,35469,1689455451912)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 21:12:45,885 DEBUG [rs(jenkins-hbase4.apache.org,35469,1689455451912)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 21:12:45,885 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 21:12:45,887 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-15 21:12:45,887 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:12:45,887 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-15 21:12:45,887 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:45,891 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:45,891 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 21:12:45,926 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689455565068.7317fa4ac99edd1952550818b153d1aa. completed. 2023-07-15 21:12:45,926 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689455565068.7317fa4ac99edd1952550818b153d1aa. 2023-07-15 21:12:45,926 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 21:12:45,926 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 21:12:45,926 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:45,926 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-15 21:12:45,926 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,38601,1689455451863' in zk 2023-07-15 21:12:45,944 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-15 21:12:45,944 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:45,944 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:12:45,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:45,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:12:45,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:12:45,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:12:45,944 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-15 21:12:45,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:12:45,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:45,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:45,951 DEBUG [rs(jenkins-hbase4.apache.org,35469,1689455451912)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689455565068.939a01b8e1f31ba28ad746d8f9e61a3a. completed. 2023-07-15 21:12:45,951 DEBUG [rs(jenkins-hbase4.apache.org,35469,1689455451912)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689455565068.939a01b8e1f31ba28ad746d8f9e61a3a. 2023-07-15 21:12:45,951 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 21:12:45,951 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 21:12:45,951 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:45,951 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-15 21:12:45,951 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,35469,1689455451912' in zk 2023-07-15 21:12:45,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:45,961 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-15 21:12:45,961 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:45,961 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:12:45,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:45,961 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-15 21:12:45,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:12:45,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:45,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:45,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:45,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:45,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,38601,1689455451863': 2023-07-15 21:12:45,964 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38601,1689455451863' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-15 21:12:45,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:45,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:12:45,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:12:45,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:12:45,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:12:45,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:45,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:45,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:45,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:45,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:12:45,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:45,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:45,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:45,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:45,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,35469,1689455451912': 2023-07-15 21:12:45,975 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35469,1689455451912' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-15 21:12:45,975 INFO [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-15 21:12:45,975 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 21:12:45,975 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 21:12:45,975 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:45,975 INFO [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 21:12:45,978 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:45,978 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:45,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:45,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:45,978 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:45,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:45,978 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:45,978 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:45,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:12:45,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:12:45,978 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:45,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:45,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:45,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:45,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:45,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:45,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:45,978 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:45,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:12:45,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:45,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:45,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:45,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:45,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:45,979 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:45,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:45,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:45,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:45,980 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:45,981 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:45,982 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:45,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:12:45,984 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:45,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:45,985 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:45,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:45,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:45,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:45,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:12:45,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:45,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:45,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:45,992 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:45,992 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:45,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:45,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:45,992 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:45,992 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:45,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:45,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:45,992 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:45,992 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:45,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:45,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:45,993 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:45,993 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:45,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:45,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:45,993 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:45,993 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:45,993 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:45,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:45,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:45,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:45,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:45,995 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:45,995 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:45,995 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:45,995 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:45,995 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:45,995 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:45,995 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:12:45,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:45,997 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:45,997 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:45,998 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,000 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp because node does not exist (not an error) 2023-07-15 21:12:46,069 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,085 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 21:12:46,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-15 21:12:46,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-15 21:12:46,087 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-15 21:12:46,165 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-15 21:12:46,165 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,165 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,166 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689455565777Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689455565997 (+220 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689455565997Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689455566044 (+47 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689455566062 (+18 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689455566165 (+103 ms) 2023-07-15 21:12:46,169 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-15 21:12:46,171 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 389 msec 2023-07-15 21:12:46,387 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 21:12:46,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-15 21:12:46,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 21:12:46,396 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35469] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689455565068.939a01b8e1f31ba28ad746d8f9e61a3a. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 21:12:46,397 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38601] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689455565068.7317fa4ac99edd1952550818b153d1aa. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 21:12:46,414 DEBUG [Listener at jenkins-hbase4.apache.org/44607] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,415 DEBUG [Listener at jenkins-hbase4.apache.org/44607] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689455565068.939a01b8e1f31ba28ad746d8f9e61a3a. 2023-07-15 21:12:46,415 INFO [Listener at jenkins-hbase4.apache.org/44607] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 21:12:46,430 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-15 21:12:46,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689455566430 (current time:1689455566430). 2023-07-15 21:12:46,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 21:12:46,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] zookeeper.ReadOnlyZKClient(139): Connect 0x1caaeca8 to 127.0.0.1:57175 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 21:12:46,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5f93ad09, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 21:12:46,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:12:46,450 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39506, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:12:46,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1caaeca8 to 127.0.0.1:57175 2023-07-15 21:12:46,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 21:12:46,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] zookeeper.ReadOnlyZKClient(139): Connect 0x7804d162 to 127.0.0.1:57175 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 21:12:46,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3300bd66, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 21:12:46,492 DEBUG [hconnection-0x7139b5ea-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:12:46,497 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39510, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:12:46,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:12:46,507 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33450, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:12:46,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7804d162 to 127.0.0.1:57175 2023-07-15 21:12:46,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 21:12:46,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-15 21:12:46,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 21:12:46,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-15 21:12:46,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-15 21:12:46,514 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-15 21:12:46,528 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689456166528 2023-07-15 21:12:46,528 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-15 21:12:46,537 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-15 21:12:46,537 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 21:12:46,539 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 21:12:46,539 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-15 21:12:46,541 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 28 msec 2023-07-15 21:12:46,542 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-15 21:12:46,543 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689456166543 2023-07-15 21:12:46,564 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,564 INFO [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-15 21:12:46,565 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:12:46,566 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-15 21:12:46,566 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-15 21:12:46,567 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,567 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,568 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:46,568 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:46,568 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:46,568 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:46,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:46,568 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:46,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:46,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:46,568 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:46,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:46,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,569 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,569 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:46,570 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:46,570 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-15 21:12:46,570 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:46,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-15 21:12:46,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,570 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-15 21:12:46,571 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-15 21:12:46,571 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-15 21:12:46,570 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 21:12:46,571 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,572 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,572 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-15 21:12:46,572 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:12:46,572 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-15 21:12:46,572 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-15 21:12:46,572 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:12:46,572 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,572 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-15 21:12:46,572 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:12:46,575 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-15 21:12:46,575 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-15 21:12:46,576 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-15 21:12:46,575 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-15 21:12:46,576 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38601,1689455451863' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-15 21:12:46,575 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-15 21:12:46,576 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-15 21:12:46,576 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44797,1689455451778' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-15 21:12:46,576 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35469,1689455451912' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-15 21:12:46,578 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,578 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:46,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:46,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:12:46,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:12:46,579 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,579 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:46,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:12:46,582 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,582 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:12:46,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:12:46,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:46,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:46,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:46,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:12:46,585 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38601,1689455451863' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-15 21:12:46,585 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@163ac68a[Count = 1] remaining members to acquire global barrier 2023-07-15 21:12:46,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:46,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:12:46,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:12:46,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:12:46,588 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,589 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,589 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:12:46,590 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,590 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:12:46,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:12:46,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:46,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:46,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:46,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:12:46,596 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35469,1689455451912' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-15 21:12:46,597 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@163ac68a[Count = 0] remaining members to acquire global barrier 2023-07-15 21:12:46,597 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-15 21:12:46,597 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,602 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,602 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,602 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,602 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-15 21:12:46,602 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-15 21:12:46,602 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-15 21:12:46,602 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,44797,1689455451778' in zk 2023-07-15 21:12:46,602 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:46,602 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 21:12:46,602 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 21:12:46,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,603 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-15 21:12:46,603 DEBUG [rs(jenkins-hbase4.apache.org,35469,1689455451912)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689455565068.939a01b8e1f31ba28ad746d8f9e61a3a. 2023-07-15 21:12:46,603 DEBUG [rs(jenkins-hbase4.apache.org,35469,1689455451912)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689455565068.939a01b8e1f31ba28ad746d8f9e61a3a. started... 2023-07-15 21:12:46,603 INFO [rs(jenkins-hbase4.apache.org,35469,1689455451912)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 939a01b8e1f31ba28ad746d8f9e61a3a 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-15 21:12:46,603 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:46,603 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 21:12:46,604 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-15 21:12:46,604 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:12:46,604 DEBUG [member: 'jenkins-hbase4.apache.org,44797,1689455451778' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-15 21:12:46,608 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 21:12:46,610 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 21:12:46,610 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689455565068.7317fa4ac99edd1952550818b153d1aa. 2023-07-15 21:12:46,610 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689455565068.7317fa4ac99edd1952550818b153d1aa. started... 2023-07-15 21:12:46,611 INFO [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 7317fa4ac99edd1952550818b153d1aa 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-15 21:12:46,639 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 21:12:46,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-15 21:12:46,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-15 21:12:46,640 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 21:12:46,663 INFO [rs(jenkins-hbase4.apache.org,35469,1689455451912)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=132 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithSkipTmp/939a01b8e1f31ba28ad746d8f9e61a3a/.tmp/cf/829daadebc0a4e7b9a852603ad34489f 2023-07-15 21:12:46,672 DEBUG [rs(jenkins-hbase4.apache.org,35469,1689455451912)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithSkipTmp/939a01b8e1f31ba28ad746d8f9e61a3a/.tmp/cf/829daadebc0a4e7b9a852603ad34489f as hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithSkipTmp/939a01b8e1f31ba28ad746d8f9e61a3a/cf/829daadebc0a4e7b9a852603ad34489f 2023-07-15 21:12:46,689 INFO [rs(jenkins-hbase4.apache.org,35469,1689455451912)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithSkipTmp/939a01b8e1f31ba28ad746d8f9e61a3a/cf/829daadebc0a4e7b9a852603ad34489f, entries=2, sequenceid=6, filesize=5.0 K 2023-07-15 21:12:46,690 INFO [rs(jenkins-hbase4.apache.org,35469,1689455451912)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 939a01b8e1f31ba28ad746d8f9e61a3a in 87ms, sequenceid=6, compaction requested=false 2023-07-15 21:12:46,691 DEBUG [rs(jenkins-hbase4.apache.org,35469,1689455451912)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-15 21:12:46,691 DEBUG [rs(jenkins-hbase4.apache.org,35469,1689455451912)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 939a01b8e1f31ba28ad746d8f9e61a3a: 2023-07-15 21:12:46,692 DEBUG [rs(jenkins-hbase4.apache.org,35469,1689455451912)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689455565068.939a01b8e1f31ba28ad746d8f9e61a3a.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,692 DEBUG [rs(jenkins-hbase4.apache.org,35469,1689455451912)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 21:12:46,692 DEBUG [rs(jenkins-hbase4.apache.org,35469,1689455451912)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithSkipTmp/939a01b8e1f31ba28ad746d8f9e61a3a/cf/829daadebc0a4e7b9a852603ad34489f] hfiles 2023-07-15 21:12:46,692 DEBUG [rs(jenkins-hbase4.apache.org,35469,1689455451912)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithSkipTmp/939a01b8e1f31ba28ad746d8f9e61a3a/cf/829daadebc0a4e7b9a852603ad34489f for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,730 INFO [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.13 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithSkipTmp/7317fa4ac99edd1952550818b153d1aa/.tmp/cf/a1ac395189d0499baa9e6f06116b2ce1 2023-07-15 21:12:46,736 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithSkipTmp/7317fa4ac99edd1952550818b153d1aa/.tmp/cf/a1ac395189d0499baa9e6f06116b2ce1 as hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithSkipTmp/7317fa4ac99edd1952550818b153d1aa/cf/a1ac395189d0499baa9e6f06116b2ce1 2023-07-15 21:12:46,742 INFO [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithSkipTmp/7317fa4ac99edd1952550818b153d1aa/cf/a1ac395189d0499baa9e6f06116b2ce1, entries=48, sequenceid=6, filesize=8.1 K 2023-07-15 21:12:46,743 INFO [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 7317fa4ac99edd1952550818b153d1aa in 132ms, sequenceid=6, compaction requested=false 2023-07-15 21:12:46,752 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7317fa4ac99edd1952550818b153d1aa: 2023-07-15 21:12:46,752 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689455565068.7317fa4ac99edd1952550818b153d1aa.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,752 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 21:12:46,752 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithSkipTmp/7317fa4ac99edd1952550818b153d1aa/cf/a1ac395189d0499baa9e6f06116b2ce1] hfiles 2023-07-15 21:12:46,752 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithSkipTmp/7317fa4ac99edd1952550818b153d1aa/cf/a1ac395189d0499baa9e6f06116b2ce1 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,772 DEBUG [rs(jenkins-hbase4.apache.org,35469,1689455451912)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689455565068.939a01b8e1f31ba28ad746d8f9e61a3a. completed. 2023-07-15 21:12:46,772 DEBUG [rs(jenkins-hbase4.apache.org,35469,1689455451912)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689455565068.939a01b8e1f31ba28ad746d8f9e61a3a. 2023-07-15 21:12:46,772 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 21:12:46,772 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 21:12:46,772 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:46,779 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-15 21:12:46,779 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,35469,1689455451912' in zk 2023-07-15 21:12:46,781 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:46,781 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-15 21:12:46,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:46,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:12:46,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:12:46,781 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:12:46,781 DEBUG [member: 'jenkins-hbase4.apache.org,35469,1689455451912' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-15 21:12:46,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:12:46,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:12:46,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:46,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:46,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:46,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:12:46,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:46,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:46,789 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689455565068.7317fa4ac99edd1952550818b153d1aa. completed. 2023-07-15 21:12:46,789 DEBUG [rs(jenkins-hbase4.apache.org,38601,1689455451863)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689455565068.7317fa4ac99edd1952550818b153d1aa. 2023-07-15 21:12:46,789 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 21:12:46,789 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 21:12:46,789 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:46,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,35469,1689455451912': 2023-07-15 21:12:46,789 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-15 21:12:46,789 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35469,1689455451912' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-15 21:12:46,789 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,38601,1689455451863' in zk 2023-07-15 21:12:46,791 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:46,791 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-15 21:12:46,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:46,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:12:46,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:12:46,791 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:12:46,791 DEBUG [member: 'jenkins-hbase4.apache.org,38601,1689455451863' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-15 21:12:46,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:12:46,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:12:46,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:46,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:46,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:46,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:12:46,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:46,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:46,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:46,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,38601,1689455451863': 2023-07-15 21:12:46,801 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38601,1689455451863' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-15 21:12:46,801 INFO [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-15 21:12:46,801 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 21:12:46,801 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 21:12:46,801 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,801 INFO [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 21:12:46,805 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,805 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,805 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,805 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:12:46,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:12:46,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,805 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:46,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,805 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:46,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,805 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:46,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:12:46,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,806 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:46,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:46,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:46,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:46,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:46,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,808 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:46,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:46,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:12:46,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:46,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:46,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:46,809 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:46,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:12:46,810 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:46,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:46,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:46,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:46,812 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:46,812 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:46,813 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:46,819 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:46,819 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:46,820 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:46,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:46,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:46,820 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:46,820 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:46,820 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:46,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:46,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:46,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:46,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:46,820 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:46,820 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,821 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:46,821 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:46,821 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,821 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:12:46,821 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,821 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,821 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:12:46,821 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,821 DEBUG [(jenkins-hbase4.apache.org,44929,1689455450325)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:12:46,821 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:12:46,821 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,821 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:46,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:46,824 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:46,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:46,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:46,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:46,841 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 21:12:46,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-15 21:12:46,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-15 21:12:46,842 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-15 21:12:46,844 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,876 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-15 21:12:46,876 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,877 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,877 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689455566528Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689455566821 (+293 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689455566821Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689455566827 (+6 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689455566838 (+11 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689455566876 (+38 ms) 2023-07-15 21:12:46,880 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-15 21:12:46,886 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 344 msec 2023-07-15 21:12:47,142 DEBUG [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 21:12:47,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-15 21:12:47,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 21:12:47,143 INFO [Listener at jenkins-hbase4.apache.org/44607] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/export-test/export-1689455567143 2023-07-15 21:12:47,143 INFO [Listener at jenkins-hbase4.apache.org/44607] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:45529, tgtDir=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/export-test/export-1689455567143, rawTgtDir=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/export-test/export-1689455567143, srcFsUri=hdfs://localhost:45529, srcDir=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f 2023-07-15 21:12:47,174 DEBUG [Listener at jenkins-hbase4.apache.org/44607] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45529, inputRoot=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f 2023-07-15 21:12:47,174 DEBUG [Listener at jenkins-hbase4.apache.org/44607] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_449655001_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/export-test/export-1689455567143, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/export-test/export-1689455567143/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,174 INFO [Listener at jenkins-hbase4.apache.org/44607] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45529, inputRoot=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f, snapshotDir=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-15 21:12:47,186 INFO [Listener at jenkins-hbase4.apache.org/44607] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/export-test/export-1689455567143/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,278 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:47,279 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:47,279 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:47,280 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:47,280 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:47,280 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:47,281 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:47,379 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/hadoop-8945916293615126125.jar 2023-07-15 21:12:47,380 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:47,380 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:47,381 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:47,381 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:47,382 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:47,382 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:47,383 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-15 21:12:47,384 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-15 21:12:47,384 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-15 21:12:47,385 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-15 21:12:47,385 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-15 21:12:47,386 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-15 21:12:47,386 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-15 21:12:47,387 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-15 21:12:47,387 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-15 21:12:47,388 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-15 21:12:47,389 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 21:12:47,389 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 21:12:47,390 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 21:12:47,390 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 21:12:47,391 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 21:12:47,391 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 21:12:47,392 DEBUG [Listener at jenkins-hbase4.apache.org/44607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 21:12:49,036 WARN [Listener at jenkins-hbase4.apache.org/44607] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-15 21:12:49,038 INFO [Listener at jenkins-hbase4.apache.org/44607] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-15 21:12:49,040 DEBUG [Listener at jenkins-hbase4.apache.org/44607] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-15 21:12:49,648 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 21:12:49,648 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 21:12:49,652 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689455460014_0006_000001 (auth:SIMPLE) 2023-07-15 21:12:50,406 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-15 21:12:50,407 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689455460014_0007_000001 (auth:SIMPLE) 2023-07-15 21:12:56,386 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689455460014_0007_000001 (auth:SIMPLE) 2023-07-15 21:12:58,671 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689455460014_0007_000001 (auth:SIMPLE) 2023-07-15 21:13:03,825 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689455460014_0007_000001 (auth:SIMPLE) 2023-07-15 21:13:05,388 INFO [Listener at jenkins-hbase4.apache.org/44607] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-15 21:13:05,389 INFO [Listener at jenkins-hbase4.apache.org/44607] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-15 21:13:05,407 INFO [Listener at jenkins-hbase4.apache.org/44607] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:13:05,407 INFO [Listener at jenkins-hbase4.apache.org/44607] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-15 21:13:05,408 INFO [Listener at jenkins-hbase4.apache.org/44607] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-15 21:13:05,408 DEBUG [Listener at jenkins-hbase4.apache.org/44607] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_404915474_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:13:05,409 DEBUG [Listener at jenkins-hbase4.apache.org/44607] snapshot.TestExportSnapshot(367): hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-15 21:13:05,409 DEBUG [Listener at jenkins-hbase4.apache.org/44607] snapshot.TestExportSnapshot(367): hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-15 21:13:05,409 DEBUG [Listener at jenkins-hbase4.apache.org/44607] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_404915474_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/export-test/export-1689455567143/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/export-test/export-1689455567143/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:13:05,409 DEBUG [Listener at jenkins-hbase4.apache.org/44607] snapshot.TestExportSnapshot(367): hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/export-test/export-1689455567143/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-15 21:13:05,410 DEBUG [Listener at jenkins-hbase4.apache.org/44607] snapshot.TestExportSnapshot(367): hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/export-test/export-1689455567143/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-15 21:13:05,415 INFO [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 21:13:05,416 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 21:13:05,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 21:13:05,420 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689455585420"}]},"ts":"1689455585420"} 2023-07-15 21:13:05,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-15 21:13:05,421 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-15 21:13:05,423 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-15 21:13:05,424 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=939a01b8e1f31ba28ad746d8f9e61a3a, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=7317fa4ac99edd1952550818b153d1aa, UNASSIGN}] 2023-07-15 21:13:05,426 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=7317fa4ac99edd1952550818b153d1aa, UNASSIGN 2023-07-15 21:13:05,426 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=939a01b8e1f31ba28ad746d8f9e61a3a, UNASSIGN 2023-07-15 21:13:05,427 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=7317fa4ac99edd1952550818b153d1aa, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:13:05,427 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=939a01b8e1f31ba28ad746d8f9e61a3a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:13:05,427 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689455565068.7317fa4ac99edd1952550818b153d1aa.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689455585427"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689455585427"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689455585427"}]},"ts":"1689455585427"} 2023-07-15 21:13:05,427 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689455565068.939a01b8e1f31ba28ad746d8f9e61a3a.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689455585427"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689455585427"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689455585427"}]},"ts":"1689455585427"} 2023-07-15 21:13:05,428 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE; CloseRegionProcedure 7317fa4ac99edd1952550818b153d1aa, server=jenkins-hbase4.apache.org,38601,1689455451863}] 2023-07-15 21:13:05,429 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=115, state=RUNNABLE; CloseRegionProcedure 939a01b8e1f31ba28ad746d8f9e61a3a, server=jenkins-hbase4.apache.org,35469,1689455451912}] 2023-07-15 21:13:05,487 ERROR [ProcedureDispatcherTimeoutThread] procedure2.RemoteProcedureDispatcher$TimeoutExecutorThread(324): DelayQueue for RemoteProcedureDispatcher is not empty when timed waiting elapsed. If this is repeated consistently, it means no element is getting expired from the queue and it might freeze the system. Queue: [containedObject=jenkins-hbase4.apache.org,38601,1689455451863, timeout=1689455585579, delay=92, operations=[pid=117, ppid=116, state=RUNNABLE; CloseRegionProcedure 7317fa4ac99edd1952550818b153d1aa, server=jenkins-hbase4.apache.org,38601,1689455451863], containedObject=jenkins-hbase4.apache.org,35469,1689455451912, timeout=1689455585580, delay=93, operations=[pid=118, ppid=115, state=RUNNABLE; CloseRegionProcedure 939a01b8e1f31ba28ad746d8f9e61a3a, server=jenkins-hbase4.apache.org,35469,1689455451912]] 2023-07-15 21:13:05,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-15 21:13:05,580 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 939a01b8e1f31ba28ad746d8f9e61a3a 2023-07-15 21:13:05,580 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 7317fa4ac99edd1952550818b153d1aa 2023-07-15 21:13:05,580 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 939a01b8e1f31ba28ad746d8f9e61a3a, disabling compactions & flushes 2023-07-15 21:13:05,580 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7317fa4ac99edd1952550818b153d1aa, disabling compactions & flushes 2023-07-15 21:13:05,580 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689455565068.939a01b8e1f31ba28ad746d8f9e61a3a. 2023-07-15 21:13:05,580 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689455565068.7317fa4ac99edd1952550818b153d1aa. 2023-07-15 21:13:05,581 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689455565068.7317fa4ac99edd1952550818b153d1aa. 2023-07-15 21:13:05,580 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689455565068.939a01b8e1f31ba28ad746d8f9e61a3a. 2023-07-15 21:13:05,581 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689455565068.7317fa4ac99edd1952550818b153d1aa. after waiting 0 ms 2023-07-15 21:13:05,581 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689455565068.7317fa4ac99edd1952550818b153d1aa. 2023-07-15 21:13:05,581 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689455565068.939a01b8e1f31ba28ad746d8f9e61a3a. after waiting 0 ms 2023-07-15 21:13:05,581 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689455565068.939a01b8e1f31ba28ad746d8f9e61a3a. 2023-07-15 21:13:05,610 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithSkipTmp/939a01b8e1f31ba28ad746d8f9e61a3a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 21:13:05,611 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/default/testtb-testExportFileSystemStateWithSkipTmp/7317fa4ac99edd1952550818b153d1aa/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 21:13:05,612 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 21:13:05,612 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 21:13:05,614 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689455565068.939a01b8e1f31ba28ad746d8f9e61a3a. 2023-07-15 21:13:05,614 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689455565068.7317fa4ac99edd1952550818b153d1aa. 2023-07-15 21:13:05,614 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 939a01b8e1f31ba28ad746d8f9e61a3a: 2023-07-15 21:13:05,614 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7317fa4ac99edd1952550818b153d1aa: 2023-07-15 21:13:05,623 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 939a01b8e1f31ba28ad746d8f9e61a3a 2023-07-15 21:13:05,623 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=939a01b8e1f31ba28ad746d8f9e61a3a, regionState=CLOSED 2023-07-15 21:13:05,623 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689455565068.939a01b8e1f31ba28ad746d8f9e61a3a.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689455585623"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689455585623"}]},"ts":"1689455585623"} 2023-07-15 21:13:05,627 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 7317fa4ac99edd1952550818b153d1aa 2023-07-15 21:13:05,628 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=7317fa4ac99edd1952550818b153d1aa, regionState=CLOSED 2023-07-15 21:13:05,628 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689455565068.7317fa4ac99edd1952550818b153d1aa.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689455585628"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689455585628"}]},"ts":"1689455585628"} 2023-07-15 21:13:05,631 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=115 2023-07-15 21:13:05,631 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=115, state=SUCCESS; CloseRegionProcedure 939a01b8e1f31ba28ad746d8f9e61a3a, server=jenkins-hbase4.apache.org,35469,1689455451912 in 196 msec 2023-07-15 21:13:05,634 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=116 2023-07-15 21:13:05,634 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; CloseRegionProcedure 7317fa4ac99edd1952550818b153d1aa, server=jenkins-hbase4.apache.org,38601,1689455451863 in 202 msec 2023-07-15 21:13:05,635 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=939a01b8e1f31ba28ad746d8f9e61a3a, UNASSIGN in 208 msec 2023-07-15 21:13:05,637 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=116, resume processing ppid=114 2023-07-15 21:13:05,637 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=7317fa4ac99edd1952550818b153d1aa, UNASSIGN in 210 msec 2023-07-15 21:13:05,637 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689455585637"}]},"ts":"1689455585637"} 2023-07-15 21:13:05,639 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-15 21:13:05,641 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-15 21:13:05,644 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 226 msec 2023-07-15 21:13:05,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-15 21:13:05,723 INFO [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-15 21:13:05,724 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 21:13:05,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 21:13:05,727 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 21:13:05,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 21:13:05,730 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 21:13:05,731 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35469] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 21:13:05,734 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/939a01b8e1f31ba28ad746d8f9e61a3a 2023-07-15 21:13:05,734 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7317fa4ac99edd1952550818b153d1aa 2023-07-15 21:13:05,737 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7317fa4ac99edd1952550818b153d1aa/cf, FileablePath, hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7317fa4ac99edd1952550818b153d1aa/recovered.edits] 2023-07-15 21:13:05,737 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/939a01b8e1f31ba28ad746d8f9e61a3a/cf, FileablePath, hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/939a01b8e1f31ba28ad746d8f9e61a3a/recovered.edits] 2023-07-15 21:13:05,737 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 21:13:05,737 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 21:13:05,738 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-15 21:13:05,738 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-15 21:13:05,739 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 21:13:05,739 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 21:13:05,740 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-15 21:13:05,740 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-15 21:13:05,741 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 21:13:05,741 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:13:05,741 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 21:13:05,741 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:13:05,741 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 21:13:05,741 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:13:05,741 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 21:13:05,741 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:13:05,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-15 21:13:05,744 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/939a01b8e1f31ba28ad746d8f9e61a3a/cf/829daadebc0a4e7b9a852603ad34489f to hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/939a01b8e1f31ba28ad746d8f9e61a3a/cf/829daadebc0a4e7b9a852603ad34489f 2023-07-15 21:13:05,744 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7317fa4ac99edd1952550818b153d1aa/cf/a1ac395189d0499baa9e6f06116b2ce1 to hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/7317fa4ac99edd1952550818b153d1aa/cf/a1ac395189d0499baa9e6f06116b2ce1 2023-07-15 21:13:05,749 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7317fa4ac99edd1952550818b153d1aa/recovered.edits/9.seqid to hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/7317fa4ac99edd1952550818b153d1aa/recovered.edits/9.seqid 2023-07-15 21:13:05,749 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/939a01b8e1f31ba28ad746d8f9e61a3a/recovered.edits/9.seqid to hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/939a01b8e1f31ba28ad746d8f9e61a3a/recovered.edits/9.seqid 2023-07-15 21:13:05,749 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7317fa4ac99edd1952550818b153d1aa 2023-07-15 21:13:05,750 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/939a01b8e1f31ba28ad746d8f9e61a3a 2023-07-15 21:13:05,750 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-15 21:13:05,753 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 21:13:05,755 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-15 21:13:05,757 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-15 21:13:05,758 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 21:13:05,758 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-15 21:13:05,758 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689455565068.939a01b8e1f31ba28ad746d8f9e61a3a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689455585758"}]},"ts":"9223372036854775807"} 2023-07-15 21:13:05,758 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689455565068.7317fa4ac99edd1952550818b153d1aa.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689455585758"}]},"ts":"9223372036854775807"} 2023-07-15 21:13:05,760 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-15 21:13:05,760 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 939a01b8e1f31ba28ad746d8f9e61a3a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689455565068.939a01b8e1f31ba28ad746d8f9e61a3a.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 7317fa4ac99edd1952550818b153d1aa, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689455565068.7317fa4ac99edd1952550818b153d1aa.', STARTKEY => '1', ENDKEY => ''}] 2023-07-15 21:13:05,760 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-15 21:13:05,760 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689455585760"}]},"ts":"9223372036854775807"} 2023-07-15 21:13:05,761 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-15 21:13:05,763 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 21:13:05,764 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 39 msec 2023-07-15 21:13:05,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-15 21:13:05,844 INFO [Listener at jenkins-hbase4.apache.org/44607] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-15 21:13:05,853 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-15 21:13:05,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:13:05,856 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-15 21:13:05,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44929] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:13:05,903 INFO [Listener at jenkins-hbase4.apache.org/44607] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=765 (was 765), OpenFileDescriptor=904 (was 927), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=601 (was 581) - SystemLoadAverage LEAK? -, ProcessCount=182 (was 182), AvailableMemoryMB=1626 (was 2081) 2023-07-15 21:13:05,904 WARN [Listener at jenkins-hbase4.apache.org/44607] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-07-15 21:13:05,904 INFO [Listener at jenkins-hbase4.apache.org/44607] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-15 21:13:05,931 INFO [Listener at jenkins-hbase4.apache.org/44607] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-15 21:13:10,064 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689455460014_0007_000001 (auth:SIMPLE) 2023-07-15 21:13:11,192 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-15 21:13:20,066 INFO [Listener at jenkins-hbase4.apache.org/44607] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-15 21:13:34,200 ERROR [Thread[Thread-409,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-15 21:13:34,201 INFO [Listener at jenkins-hbase4.apache.org/44607] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-15 21:13:34,313 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-15 21:13:34,348 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-15 21:13:34,351 ERROR [Thread[Thread-419,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-15 21:13:34,385 INFO [Listener at jenkins-hbase4.apache.org/44607] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-15 21:13:34,390 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-15 21:13:34,391 INFO [Listener at jenkins-hbase4.apache.org/44607] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-15 21:13:34,391 INFO [Listener at jenkins-hbase4.apache.org/44607] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-15 21:13:34,391 INFO [Listener at jenkins-hbase4.apache.org/44607] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-15 21:13:34,391 DEBUG [Listener at jenkins-hbase4.apache.org/44607] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x49f3c037 to 127.0.0.1:57175 2023-07-15 21:13:34,391 DEBUG [Listener at jenkins-hbase4.apache.org/44607] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 21:13:34,391 DEBUG [Listener at jenkins-hbase4.apache.org/44607] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-15 21:13:34,392 DEBUG [Listener at jenkins-hbase4.apache.org/44607] util.JVMClusterUtil(257): Found active master hash=1355779610, stopped=false 2023-07-15 21:13:34,392 DEBUG [Listener at jenkins-hbase4.apache.org/44607] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 21:13:34,392 DEBUG [Listener at jenkins-hbase4.apache.org/44607] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-15 21:13:34,392 INFO [Listener at jenkins-hbase4.apache.org/44607] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,44929,1689455450325 2023-07-15 21:13:34,394 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-15 21:13:34,394 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-15 21:13:34,394 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 21:13:34,394 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-15 21:13:34,394 INFO [Listener at jenkins-hbase4.apache.org/44607] procedure2.ProcedureExecutor(629): Stopping 2023-07-15 21:13:34,395 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-15 21:13:34,395 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 21:13:34,395 DEBUG [Listener at jenkins-hbase4.apache.org/44607] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x32c428a1 to 127.0.0.1:57175 2023-07-15 21:13:34,395 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 21:13:34,395 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 21:13:34,395 INFO [RS:1;jenkins-hbase4:38601] regionserver.HRegionServer(1064): Closing user regions 2023-07-15 21:13:34,396 DEBUG [Listener at jenkins-hbase4.apache.org/44607] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 21:13:34,396 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 21:13:34,396 INFO [Listener at jenkins-hbase4.apache.org/44607] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,44797,1689455451778' ***** 2023-07-15 21:13:34,397 DEBUG [Listener at jenkins-hbase4.apache.org/44607] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 21:13:34,397 INFO [Listener at jenkins-hbase4.apache.org/44607] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-15 21:13:34,397 INFO [RS:1;jenkins-hbase4:38601] regionserver.HRegionServer(3305): Received CLOSE for 51884e1d2b0369b46d228cfb948034dc 2023-07-15 21:13:34,397 INFO [RS:0;jenkins-hbase4:44797] regionserver.HeapMemoryManager(220): Stopping 2023-07-15 21:13:34,397 INFO [RS:0;jenkins-hbase4:44797] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-15 21:13:34,398 INFO [RS:0;jenkins-hbase4:44797] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-15 21:13:34,398 INFO [RS:0;jenkins-hbase4:44797] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:13:34,398 DEBUG [RS:0;jenkins-hbase4:44797] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0dd3a702 to 127.0.0.1:57175 2023-07-15 21:13:34,398 DEBUG [RS:0;jenkins-hbase4:44797] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 21:13:34,398 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-15 21:13:34,403 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 51884e1d2b0369b46d228cfb948034dc, disabling compactions & flushes 2023-07-15 21:13:34,403 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689455454790.51884e1d2b0369b46d228cfb948034dc. 2023-07-15 21:13:34,403 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689455454790.51884e1d2b0369b46d228cfb948034dc. 2023-07-15 21:13:34,403 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689455454790.51884e1d2b0369b46d228cfb948034dc. after waiting 0 ms 2023-07-15 21:13:34,403 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689455454790.51884e1d2b0369b46d228cfb948034dc. 2023-07-15 21:13:34,403 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 51884e1d2b0369b46d228cfb948034dc 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-15 21:13:34,403 INFO [Listener at jenkins-hbase4.apache.org/44607] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,38601,1689455451863' ***** 2023-07-15 21:13:34,403 DEBUG [Listener at jenkins-hbase4.apache.org/44607] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 21:13:34,403 INFO [Listener at jenkins-hbase4.apache.org/44607] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-15 21:13:34,403 INFO [Listener at jenkins-hbase4.apache.org/44607] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,35469,1689455451912' ***** 2023-07-15 21:13:34,403 DEBUG [Listener at jenkins-hbase4.apache.org/44607] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 21:13:34,404 INFO [Listener at jenkins-hbase4.apache.org/44607] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-15 21:13:34,404 INFO [RS:2;jenkins-hbase4:35469] regionserver.HeapMemoryManager(220): Stopping 2023-07-15 21:13:34,404 INFO [RS:2;jenkins-hbase4:35469] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-15 21:13:34,404 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-15 21:13:34,404 INFO [RS:2;jenkins-hbase4:35469] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-15 21:13:34,405 INFO [RS:0;jenkins-hbase4:44797] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,44797,1689455451778; all regions closed. 2023-07-15 21:13:34,406 INFO [RS:2;jenkins-hbase4:35469] regionserver.HRegionServer(3305): Received CLOSE for 05c4da87d576dbade0070ea869b96124 2023-07-15 21:13:34,406 INFO [RS:2;jenkins-hbase4:35469] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:13:34,406 DEBUG [RS:2;jenkins-hbase4:35469] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4303c312 to 127.0.0.1:57175 2023-07-15 21:13:34,406 DEBUG [RS:2;jenkins-hbase4:35469] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 21:13:34,406 INFO [RS:1;jenkins-hbase4:38601] regionserver.HeapMemoryManager(220): Stopping 2023-07-15 21:13:34,409 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 05c4da87d576dbade0070ea869b96124, disabling compactions & flushes 2023-07-15 21:13:34,413 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-15 21:13:34,408 INFO [RS:2;jenkins-hbase4:35469] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-15 21:13:34,413 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689455455958.05c4da87d576dbade0070ea869b96124. 2023-07-15 21:13:34,412 INFO [RS:1;jenkins-hbase4:38601] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-15 21:13:34,413 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689455455958.05c4da87d576dbade0070ea869b96124. 2023-07-15 21:13:34,413 DEBUG [RS:2;jenkins-hbase4:35469] regionserver.HRegionServer(1478): Online Regions={05c4da87d576dbade0070ea869b96124=hbase:acl,,1689455455958.05c4da87d576dbade0070ea869b96124.} 2023-07-15 21:13:34,413 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689455455958.05c4da87d576dbade0070ea869b96124. after waiting 0 ms 2023-07-15 21:13:34,413 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689455455958.05c4da87d576dbade0070ea869b96124. 2023-07-15 21:13:34,413 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 05c4da87d576dbade0070ea869b96124 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-15 21:13:34,413 INFO [RS:1;jenkins-hbase4:38601] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-15 21:13:34,414 DEBUG [RS:2;jenkins-hbase4:35469] regionserver.HRegionServer(1504): Waiting on 05c4da87d576dbade0070ea869b96124 2023-07-15 21:13:34,414 INFO [RS:1;jenkins-hbase4:38601] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:13:34,414 DEBUG [RS:1;jenkins-hbase4:38601] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1c87e184 to 127.0.0.1:57175 2023-07-15 21:13:34,414 DEBUG [RS:1;jenkins-hbase4:38601] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 21:13:34,427 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-15 21:13:34,427 INFO [RS:1;jenkins-hbase4:38601] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-15 21:13:34,428 INFO [RS:1;jenkins-hbase4:38601] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-15 21:13:34,428 INFO [RS:1;jenkins-hbase4:38601] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-15 21:13:34,428 INFO [RS:1;jenkins-hbase4:38601] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-15 21:13:34,445 INFO [RS:1;jenkins-hbase4:38601] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-15 21:13:34,447 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-15 21:13:34,447 DEBUG [RS:1;jenkins-hbase4:38601] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740, 51884e1d2b0369b46d228cfb948034dc=hbase:namespace,,1689455454790.51884e1d2b0369b46d228cfb948034dc.} 2023-07-15 21:13:34,447 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-15 21:13:34,448 DEBUG [RS:1;jenkins-hbase4:38601] regionserver.HRegionServer(1504): Waiting on 1588230740, 51884e1d2b0369b46d228cfb948034dc 2023-07-15 21:13:34,448 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-15 21:13:34,449 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-15 21:13:34,449 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-15 21:13:34,449 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-15 21:13:34,449 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-15 21:13:34,449 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-15 21:13:34,473 DEBUG [RS:0;jenkins-hbase4:44797] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/oldWALs 2023-07-15 21:13:34,474 INFO [RS:0;jenkins-hbase4:44797] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44797%2C1689455451778:(num 1689455454042) 2023-07-15 21:13:34,474 DEBUG [RS:0;jenkins-hbase4:44797] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 21:13:34,474 INFO [RS:0;jenkins-hbase4:44797] regionserver.LeaseManager(133): Closed leases 2023-07-15 21:13:34,476 INFO [RS:0;jenkins-hbase4:44797] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-15 21:13:34,476 INFO [RS:0;jenkins-hbase4:44797] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-15 21:13:34,476 INFO [RS:0;jenkins-hbase4:44797] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-15 21:13:34,476 INFO [RS:0;jenkins-hbase4:44797] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-15 21:13:34,477 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-15 21:13:34,509 INFO [RS:0;jenkins-hbase4:44797] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44797 2023-07-15 21:13:34,521 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:13:34,521 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-15 21:13:34,521 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-15 21:13:34,521 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:13:34,521 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44797,1689455451778 2023-07-15 21:13:34,521 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-15 21:13:34,521 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-15 21:13:34,533 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/hbase/acl/05c4da87d576dbade0070ea869b96124/.tmp/l/2bc70710fa6841b38e3e44b35e131bde 2023-07-15 21:13:34,535 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,44797,1689455451778] 2023-07-15 21:13:34,537 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,44797,1689455451778; numProcessing=1 2023-07-15 21:13:34,538 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/hbase/namespace/51884e1d2b0369b46d228cfb948034dc/.tmp/info/0ff944a37b824a7188dc296bcf79f135 2023-07-15 21:13:34,541 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,44797,1689455451778 already deleted, retry=false 2023-07-15 21:13:34,541 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,44797,1689455451778 expired; onlineServers=2 2023-07-15 21:13:34,561 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2bc70710fa6841b38e3e44b35e131bde 2023-07-15 21:13:34,562 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/hbase/meta/1588230740/.tmp/info/ef2fab040fae4438b371b1620ae0dbc1 2023-07-15 21:13:34,563 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/hbase/acl/05c4da87d576dbade0070ea869b96124/.tmp/l/2bc70710fa6841b38e3e44b35e131bde as hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/hbase/acl/05c4da87d576dbade0070ea869b96124/l/2bc70710fa6841b38e3e44b35e131bde 2023-07-15 21:13:34,565 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/hbase/namespace/51884e1d2b0369b46d228cfb948034dc/.tmp/info/0ff944a37b824a7188dc296bcf79f135 as hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/hbase/namespace/51884e1d2b0369b46d228cfb948034dc/info/0ff944a37b824a7188dc296bcf79f135 2023-07-15 21:13:34,572 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2bc70710fa6841b38e3e44b35e131bde 2023-07-15 21:13:34,572 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/hbase/acl/05c4da87d576dbade0070ea869b96124/l/2bc70710fa6841b38e3e44b35e131bde, entries=7, sequenceid=18, filesize=5.2 K 2023-07-15 21:13:34,573 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 05c4da87d576dbade0070ea869b96124 in 160ms, sequenceid=18, compaction requested=false 2023-07-15 21:13:34,576 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/hbase/namespace/51884e1d2b0369b46d228cfb948034dc/info/0ff944a37b824a7188dc296bcf79f135, entries=2, sequenceid=6, filesize=4.8 K 2023-07-15 21:13:34,576 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ef2fab040fae4438b371b1620ae0dbc1 2023-07-15 21:13:34,579 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 51884e1d2b0369b46d228cfb948034dc in 176ms, sequenceid=6, compaction requested=false 2023-07-15 21:13:34,587 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/hbase/acl/05c4da87d576dbade0070ea869b96124/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-15 21:13:34,590 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 21:13:34,591 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689455455958.05c4da87d576dbade0070ea869b96124. 2023-07-15 21:13:34,591 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 05c4da87d576dbade0070ea869b96124: 2023-07-15 21:13:34,591 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689455455958.05c4da87d576dbade0070ea869b96124. 2023-07-15 21:13:34,594 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/hbase/namespace/51884e1d2b0369b46d228cfb948034dc/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 21:13:34,596 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 21:13:34,597 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689455454790.51884e1d2b0369b46d228cfb948034dc. 2023-07-15 21:13:34,597 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 51884e1d2b0369b46d228cfb948034dc: 2023-07-15 21:13:34,597 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689455454790.51884e1d2b0369b46d228cfb948034dc. 2023-07-15 21:13:34,607 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/hbase/meta/1588230740/.tmp/rep_barrier/da7589abce614a4ebf76ff924d363f3c 2023-07-15 21:13:34,612 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for da7589abce614a4ebf76ff924d363f3c 2023-07-15 21:13:34,614 INFO [RS:2;jenkins-hbase4:35469] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,35469,1689455451912; all regions closed. 2023-07-15 21:13:34,625 DEBUG [RS:2;jenkins-hbase4:35469] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/oldWALs 2023-07-15 21:13:34,625 INFO [RS:2;jenkins-hbase4:35469] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35469%2C1689455451912:(num 1689455454029) 2023-07-15 21:13:34,625 DEBUG [RS:2;jenkins-hbase4:35469] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 21:13:34,625 INFO [RS:2;jenkins-hbase4:35469] regionserver.LeaseManager(133): Closed leases 2023-07-15 21:13:34,628 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/hbase/meta/1588230740/.tmp/table/04c7b7ed713547ac8dda9c51c5927fa1 2023-07-15 21:13:34,632 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 04c7b7ed713547ac8dda9c51c5927fa1 2023-07-15 21:13:34,633 INFO [RS:2;jenkins-hbase4:35469] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-15 21:13:34,633 INFO [RS:2;jenkins-hbase4:35469] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-15 21:13:34,633 INFO [RS:2;jenkins-hbase4:35469] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-15 21:13:34,633 INFO [RS:2;jenkins-hbase4:35469] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-15 21:13:34,633 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-15 21:13:34,635 INFO [RS:2;jenkins-hbase4:35469] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35469 2023-07-15 21:13:34,635 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/hbase/meta/1588230740/.tmp/info/ef2fab040fae4438b371b1620ae0dbc1 as hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/hbase/meta/1588230740/info/ef2fab040fae4438b371b1620ae0dbc1 2023-07-15 21:13:34,637 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:13:34,637 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35469,1689455451912 2023-07-15 21:13:34,637 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-15 21:13:34,638 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 21:13:34,638 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:44797-0x1016ad2d8110001, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 21:13:34,638 INFO [RS:0;jenkins-hbase4:44797] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,44797,1689455451778; zookeeper connection closed. 2023-07-15 21:13:34,639 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@ff8d906] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@ff8d906 2023-07-15 21:13:34,639 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,35469,1689455451912] 2023-07-15 21:13:34,639 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,35469,1689455451912; numProcessing=2 2023-07-15 21:13:34,640 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,35469,1689455451912 already deleted, retry=false 2023-07-15 21:13:34,640 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,35469,1689455451912 expired; onlineServers=1 2023-07-15 21:13:34,641 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ef2fab040fae4438b371b1620ae0dbc1 2023-07-15 21:13:34,641 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/hbase/meta/1588230740/info/ef2fab040fae4438b371b1620ae0dbc1, entries=48, sequenceid=131, filesize=10.3 K 2023-07-15 21:13:34,642 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/hbase/meta/1588230740/.tmp/rep_barrier/da7589abce614a4ebf76ff924d363f3c as hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/hbase/meta/1588230740/rep_barrier/da7589abce614a4ebf76ff924d363f3c 2023-07-15 21:13:34,647 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for da7589abce614a4ebf76ff924d363f3c 2023-07-15 21:13:34,647 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/hbase/meta/1588230740/rep_barrier/da7589abce614a4ebf76ff924d363f3c, entries=13, sequenceid=131, filesize=6.4 K 2023-07-15 21:13:34,648 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/hbase/meta/1588230740/.tmp/table/04c7b7ed713547ac8dda9c51c5927fa1 as hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/hbase/meta/1588230740/table/04c7b7ed713547ac8dda9c51c5927fa1 2023-07-15 21:13:34,648 DEBUG [RS:1;jenkins-hbase4:38601] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-15 21:13:34,652 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 04c7b7ed713547ac8dda9c51c5927fa1 2023-07-15 21:13:34,652 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/hbase/meta/1588230740/table/04c7b7ed713547ac8dda9c51c5927fa1, entries=24, sequenceid=131, filesize=6.9 K 2023-07-15 21:13:34,653 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 204ms, sequenceid=131, compaction requested=false 2023-07-15 21:13:34,667 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-15 21:13:34,667 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 21:13:34,667 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-15 21:13:34,668 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-15 21:13:34,668 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-15 21:13:34,668 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-15 21:13:34,740 INFO [RS:2;jenkins-hbase4:35469] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,35469,1689455451912; zookeeper connection closed. 2023-07-15 21:13:34,740 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 21:13:34,740 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:35469-0x1016ad2d8110003, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 21:13:34,740 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1bc1c4df] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1bc1c4df 2023-07-15 21:13:34,830 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-15 21:13:34,830 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-15 21:13:34,848 INFO [RS:1;jenkins-hbase4:38601] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,38601,1689455451863; all regions closed. 2023-07-15 21:13:34,854 DEBUG [RS:1;jenkins-hbase4:38601] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/oldWALs 2023-07-15 21:13:34,854 INFO [RS:1;jenkins-hbase4:38601] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38601%2C1689455451863.meta:.meta(num 1689455454392) 2023-07-15 21:13:34,860 DEBUG [RS:1;jenkins-hbase4:38601] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/oldWALs 2023-07-15 21:13:34,860 INFO [RS:1;jenkins-hbase4:38601] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38601%2C1689455451863:(num 1689455454052) 2023-07-15 21:13:34,860 DEBUG [RS:1;jenkins-hbase4:38601] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 21:13:34,860 INFO [RS:1;jenkins-hbase4:38601] regionserver.LeaseManager(133): Closed leases 2023-07-15 21:13:34,860 INFO [RS:1;jenkins-hbase4:38601] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-15 21:13:34,860 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-15 21:13:34,861 INFO [RS:1;jenkins-hbase4:38601] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38601 2023-07-15 21:13:34,863 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-15 21:13:34,863 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38601,1689455451863 2023-07-15 21:13:34,865 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,38601,1689455451863] 2023-07-15 21:13:34,865 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,38601,1689455451863; numProcessing=3 2023-07-15 21:13:34,866 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,38601,1689455451863 already deleted, retry=false 2023-07-15 21:13:34,866 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,38601,1689455451863 expired; onlineServers=0 2023-07-15 21:13:34,866 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,44929,1689455450325' ***** 2023-07-15 21:13:34,866 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-15 21:13:34,866 DEBUG [M:0;jenkins-hbase4:44929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@11f28421, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-15 21:13:34,866 INFO [M:0;jenkins-hbase4:44929] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,44929,1689455450325 2023-07-15 21:13:34,866 INFO [M:0;jenkins-hbase4:44929] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,44929,1689455450325; all regions closed. 2023-07-15 21:13:34,866 DEBUG [M:0;jenkins-hbase4:44929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 21:13:34,867 DEBUG [M:0;jenkins-hbase4:44929] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-15 21:13:34,867 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-15 21:13:34,867 DEBUG [M:0;jenkins-hbase4:44929] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-15 21:13:34,867 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689455453600] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689455453600,5,FailOnTimeoutGroup] 2023-07-15 21:13:34,867 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689455453600] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689455453600,5,FailOnTimeoutGroup] 2023-07-15 21:13:34,867 INFO [M:0;jenkins-hbase4:44929] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-15 21:13:34,867 INFO [M:0;jenkins-hbase4:44929] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-15 21:13:34,867 INFO [M:0;jenkins-hbase4:44929] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-15 21:13:34,867 DEBUG [M:0;jenkins-hbase4:44929] master.HMaster(1512): Stopping service threads 2023-07-15 21:13:34,867 INFO [M:0;jenkins-hbase4:44929] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-15 21:13:34,868 ERROR [M:0;jenkins-hbase4:44929] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-15 21:13:34,868 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-15 21:13:34,868 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 21:13:34,868 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-15 21:13:34,868 INFO [M:0;jenkins-hbase4:44929] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-15 21:13:34,868 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-15 21:13:34,869 DEBUG [M:0;jenkins-hbase4:44929] zookeeper.ZKUtil(398): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-15 21:13:34,869 WARN [M:0;jenkins-hbase4:44929] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-15 21:13:34,869 INFO [M:0;jenkins-hbase4:44929] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-15 21:13:34,869 INFO [M:0;jenkins-hbase4:44929] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-15 21:13:34,870 DEBUG [M:0;jenkins-hbase4:44929] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-15 21:13:34,870 INFO [M:0;jenkins-hbase4:44929] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 21:13:34,870 DEBUG [M:0;jenkins-hbase4:44929] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 21:13:34,870 DEBUG [M:0;jenkins-hbase4:44929] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-15 21:13:34,870 DEBUG [M:0;jenkins-hbase4:44929] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 21:13:34,870 INFO [M:0;jenkins-hbase4:44929] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=373.33 KB heapSize=449.55 KB 2023-07-15 21:13:34,907 INFO [M:0;jenkins-hbase4:44929] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=373.33 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/7cad1d20fd8c4cbf94e5a3be5b85e8b6 2023-07-15 21:13:34,912 INFO [M:0;jenkins-hbase4:44929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7cad1d20fd8c4cbf94e5a3be5b85e8b6 2023-07-15 21:13:34,914 DEBUG [M:0;jenkins-hbase4:44929] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/7cad1d20fd8c4cbf94e5a3be5b85e8b6 as hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/7cad1d20fd8c4cbf94e5a3be5b85e8b6 2023-07-15 21:13:34,919 INFO [M:0;jenkins-hbase4:44929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7cad1d20fd8c4cbf94e5a3be5b85e8b6 2023-07-15 21:13:34,919 INFO [M:0;jenkins-hbase4:44929] regionserver.HStore(1080): Added hdfs://localhost:45529/user/jenkins/test-data/421a2e47-a126-80dc-2751-92e9f41a247f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/7cad1d20fd8c4cbf94e5a3be5b85e8b6, entries=119, sequenceid=899, filesize=28.4 K 2023-07-15 21:13:34,920 INFO [M:0;jenkins-hbase4:44929] regionserver.HRegion(2948): Finished flush of dataSize ~373.33 KB/382289, heapSize ~449.54 KB/460328, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 50ms, sequenceid=899, compaction requested=false 2023-07-15 21:13:34,922 INFO [M:0;jenkins-hbase4:44929] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 21:13:34,922 DEBUG [M:0;jenkins-hbase4:44929] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-15 21:13:34,931 INFO [M:0;jenkins-hbase4:44929] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-15 21:13:34,932 INFO [M:0;jenkins-hbase4:44929] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44929 2023-07-15 21:13:34,932 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-15 21:13:34,933 DEBUG [M:0;jenkins-hbase4:44929] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,44929,1689455450325 already deleted, retry=false 2023-07-15 21:13:34,965 INFO [RS:1;jenkins-hbase4:38601] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,38601,1689455451863; zookeeper connection closed. 2023-07-15 21:13:34,965 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 21:13:34,965 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): regionserver:38601-0x1016ad2d8110002, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 21:13:34,975 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@584e1c29] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@584e1c29 2023-07-15 21:13:34,977 INFO [Listener at jenkins-hbase4.apache.org/44607] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-15 21:13:35,065 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 21:13:35,065 DEBUG [Listener at localhost/33869-EventThread] zookeeper.ZKWatcher(600): master:44929-0x1016ad2d8110000, quorum=127.0.0.1:57175, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 21:13:35,065 INFO [M:0;jenkins-hbase4:44929] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,44929,1689455450325; zookeeper connection closed. 2023-07-15 21:13:35,068 WARN [Listener at jenkins-hbase4.apache.org/44607] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-15 21:13:35,128 INFO [Listener at jenkins-hbase4.apache.org/44607] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-15 21:13:35,233 WARN [BP-995756726-172.31.14.131-1689455446321 heartbeating to localhost/127.0.0.1:45529] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-15 21:13:35,233 WARN [BP-995756726-172.31.14.131-1689455446321 heartbeating to localhost/127.0.0.1:45529] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-995756726-172.31.14.131-1689455446321 (Datanode Uuid eacbdee9-5025-449b-9661-bbde62b6d035) service to localhost/127.0.0.1:45529 2023-07-15 21:13:35,235 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/cluster_744bf9ce-7834-b46f-9b3b-2856eea562b1/dfs/data/data5/current/BP-995756726-172.31.14.131-1689455446321] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-15 21:13:35,235 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/cluster_744bf9ce-7834-b46f-9b3b-2856eea562b1/dfs/data/data6/current/BP-995756726-172.31.14.131-1689455446321] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-15 21:13:35,236 WARN [Listener at jenkins-hbase4.apache.org/44607] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-15 21:13:35,240 INFO [Listener at jenkins-hbase4.apache.org/44607] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-15 21:13:35,344 WARN [BP-995756726-172.31.14.131-1689455446321 heartbeating to localhost/127.0.0.1:45529] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-15 21:13:35,344 WARN [BP-995756726-172.31.14.131-1689455446321 heartbeating to localhost/127.0.0.1:45529] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-995756726-172.31.14.131-1689455446321 (Datanode Uuid 1b962843-5474-4efb-ab5a-166842a8ec9d) service to localhost/127.0.0.1:45529 2023-07-15 21:13:35,345 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/cluster_744bf9ce-7834-b46f-9b3b-2856eea562b1/dfs/data/data3/current/BP-995756726-172.31.14.131-1689455446321] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-15 21:13:35,345 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/cluster_744bf9ce-7834-b46f-9b3b-2856eea562b1/dfs/data/data4/current/BP-995756726-172.31.14.131-1689455446321] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-15 21:13:35,347 WARN [Listener at jenkins-hbase4.apache.org/44607] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-15 21:13:35,364 INFO [Listener at jenkins-hbase4.apache.org/44607] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-15 21:13:35,366 WARN [BP-995756726-172.31.14.131-1689455446321 heartbeating to localhost/127.0.0.1:45529] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-15 21:13:35,366 WARN [BP-995756726-172.31.14.131-1689455446321 heartbeating to localhost/127.0.0.1:45529] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-995756726-172.31.14.131-1689455446321 (Datanode Uuid bf7c710d-cc5a-4845-b944-adee1af6f560) service to localhost/127.0.0.1:45529 2023-07-15 21:13:35,367 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/cluster_744bf9ce-7834-b46f-9b3b-2856eea562b1/dfs/data/data1/current/BP-995756726-172.31.14.131-1689455446321] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-15 21:13:35,367 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3d11d136-ae55-cdfa-e358-8b47c78443c4/cluster_744bf9ce-7834-b46f-9b3b-2856eea562b1/dfs/data/data2/current/BP-995756726-172.31.14.131-1689455446321] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-15 21:13:35,424 INFO [Listener at jenkins-hbase4.apache.org/44607] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-15 21:13:35,563 INFO [Listener at jenkins-hbase4.apache.org/44607] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-15 21:13:35,683 INFO [Listener at jenkins-hbase4.apache.org/44607] hbase.HBaseTestingUtility(1293): Minicluster is down